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Over  the  past  d'1  venrc  i  so  i  ent  i  f  "ic  discipline  which  is  refened 
to  variously  ns  a  general  thonry  of  common  i  ra  f  i  on  (A.  A.  Khar! evichl ,  a 
mathematical  theory  of  ootnnuir  i  cat  i  on  (1.  Shannon'),  a  statistical  theorv 
of  communication  (T  .  "idd  letup)  ,  a  thcoiv  of  commun  i  ca  t  i  <  in  a  ''run-! 
sense  tin  distinction  from  a  theorv  of  communication  in  a  nanow  sense 
one 'nrass  i  ni’  a  unuititative  determi  nat  i  op  of  i  n  format  i  on  and  cod:;,; 

■ ! '  e  ■  •  -  ,  s. .  •  t.  . ’  :  ...  •••'•  :•••'!•.  •  •*.  '•  ... 

sever  1 1  t  t'cl.no  i  op  i  i  il  and  mathematical  sciences.  Munv  n  i:  u-rnph-.  *  n»i 
textbooks  which  lil'fer  from  one  another  i  n  the  ranee  of  pro1  lens  t  rente!, 
ti'.e  lines  of  thought  pursue.!  and  the  intended  hi. lienee  have  !  een  devoted 
to  theory.  However,  it  until  !  he  difficult  to  find  imonc  then’  a 

worl  first,  which  gives  sufficient  treatment  to  problems  in  the  theorv  of 
transmission  and  reception  of  discrete  messages ,  these  problems  in  all 
nrob.ah  i  1  i  t  y ,  being  at  the  present  time  the  most  pressing  for  communication 
technology  and,  second,  wfticn  is  intended  tv't  for  specialists  in  the  field 
of  mathematics  but  for  research  engineers  engaged  in  ileve 1  op i ng  communica¬ 
tion  systems.  This  situation  motivated  the  author  to  rather  and  syst  em.a  t  i  r.e 
extensive  materials  scattered  through  out  manv  raga nines  and  to  combine 
them  with  his  own  original  word  in  a  1  ud  which  apnea  re  I  for  the  first 
tine  in  1  d<o . 

This  book  is  the  second  edition  am!  it  reflects  extensive  revision 
and  addition.  Manv  results  which  have  appeared  in  publications  or  were 
obtained  by  the  author  following  the  printing  of  the  first  edition  are 
included.  The  ranee  »f  questions  treated,  i  >•  somewhat  extem’ed  and  errors 
fouml  by  ’ho  author  and  readers  have  '  een  corrected.  I  wo  new  chapters  de¬ 
tail'd  to  mult  iplexinv  channels  and  'urildim-  feedback  s  vs  terns ,  w'dr'i  re¬ 
ceived.  only  superficial  treatment  in  *le  *'irst  edition,  have  boer  added, 

A  short  table  of  '.'-'unctions  his  been  added  in  the  form  of  an  appendix 
inasmuch  is  m>  sticlt  table  is  to  '  r  found  in  ivailable  reference  literature, 
'urtner,  several  sect  ions  which  ire  no  !  oncer  of  anv  particular  interest 
have  been  deleted.  It:  'view  the  limited,  scope  of  the  book  it  was  not 
considered  possible  to  rive  full  treatment  to  numerous  now  results  per¬ 
taining  to  diversity  reception  and  »o  the  reception  of  messages  trans¬ 
mitted  over-parallel  channels.  special  mor.i'c  rat'h  prepared  bv  1.  < . 
Andronov  with  the  author’s  help  will  be  devoted  to  these  problems. 

1.  b ,  Andronov  cave  the  , author  a  great  deal  of  help  in  working  on 
the  second  edition.  ,-poc  i  f  i  ca  1 1  v  ,  he  wrote  :’em.irk  4  in  Chapter  V  and 
part  of  the  new  material  in  Chapter  vl.  H.  !'.  Kasyan  cave  the  author  a 
great:  deal  of  help  in  arranging  the  format  of  the  manuscript  and  preparing 
it  for  printing  and  also  in  writing  Section  10.“. 

Valuable  comments  and  advice  from  manv  readers,  especial  lv  1  .  f. 
Borodin,  P.  P.  Klovskiv,  V.  I.  1  orchil,  b.  11.  Levin,  Yu.  t; .  Lenin,  A.  '. 
Sikarev,  f.  C.  Khanovich,  B.  s.  [sybakov  and  also  from  man'  others  were 
taken  into  consideration  in  revising  the  book.  The  author  is  indebted 
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be  considered  apart'  from  one  another.  Imieed,  each  of  them  could  be 
solved  at  the  expense  of  the  others,  'or  example,  it  i s  easily  possible 
to  increase  the  fidelity  of  information  received  bv  decreasing  the  rate 
of  transmission  or  by  increasirut  the  strength  of  the  signal,  etc  Tbere- 
fore,  only  by  taking  all  these  indicated  factors  into  consideration  are 
we  able  to  correct  iy  formulate  the  problem  of  optima!  design  for  a  ooin- 
minication  system.  fhe  way  in  which  this  problem  is  posed  ’epends  on 
concrete  conditions.  In  ‘•'onto  cases  the  greatest  possible  economy  (or  the 
least  possible*  expand i ture  *f  powerl  muc'  '*e  ruaranteod  while*  me.* e' t  in o 
demands  for  a  given  level  of  fide  1  i  t  v  and  rate*  ol  t  r  msmi  •  s  i  on  .  in  other 
cases  the  rate  of  transmission  and  signal  strength  mav  he  prescribed  and 
providing  for  maximal  fidelitv  may  be  reepiired,  etc. 

Such  problems  constantly  arise  before*  engineers  who  are  <'  •signing 
and  operating  various  systems  and  information  transmission  lines  am;  also 
developing  suitable  equipment.  In  order  to  solve  them  these  engineers 
must  have  precise  knowledge  of  the  theorv  which  permit  them  to  find  op¬ 
timal  (or  close  to  optima  11  conditions  bv  comparing  relatively  simple 
calculations  without  resort  to  expensive  experiments. 

A  general  theory  *f  communication  came  into  existence  r<  lativt  !  v 
recently,  It  is  closely  associated,  on  one  hand,  with  the  cybernetics 
and,  on  the  other  hand,  with  the  theory  of  probability,  mathematical  sta¬ 
tistics,  decision  theory,  theorv  of  random  processes,  etc.  In  the  main 
it  has  developed  along  two  lines,  ’’’he  rirst  line  was  begun  with  the  work'- 
of  V.  A.  Hotel' nikov  in  the  USSR  and  P.  "iddleton  and  othe *s  in  the  PSA. 

It  amounts,  in  essence,  to  a  theory  of  st at ; o i ca 1  detectitn  and  discri¬ 
mination  of  signals  or  to  a  theorv  of  potential  resistance  to  inter¬ 
ference.  The  second  line,  which  is  1 nown  as  information  1  eorv,  wa« 
begun  by  the  works  of  r.  Shannon  fl'SM  .  It  is  based  in  In  ,p*  measure  on 
the  works  of  '.  \.  Kolmogorov  an<!  has  found  a  rig  -ms  foupd.it  i  <*r.  in  *‘ho 
works  of  \.  Vi.  fh  inch  in  an!  '•’ .  !..  Pobrush  i  n ,  \.  ravnstev:i ,  and  others. 

In  these  works,  than!  s  to  *■!.<•*  intrnlucfion  of  the  concept  of  "amount  •**' 
information,"  it  was  found  possible  to  think  in  a  different  kiv  a' out  ’he 
technical  indicators  a  channel  of  common i cat i on ,  such  as  carrying 
capacity  and  resistance  to  interference.  Poring  the  past  few  year* 
thought  has  been  given  to  a  synthesis  of  these  two  lines  wh i  -h  supple¬ 
ment  one  another  and  are  closelv  bound  bv  the  general  nature  of  fhe  orob- 
loms  to  which  they  are  applied. 

As  already  noted,  the  case  of  transmission  of  discrete  messages 
as  the  simple;t  case,  has  been  developed  in  greatest  detail  in  the  general 
theory  of  communication.  Nevertheless,  this  theory  still  fails  to  give  an 
exhaustive  answer  to  many  problems  which  are  advanced  bv  modern  communion 
tion  practice.  Thus,  resistance  to  interference  and  carrying  capacity  of 
a  line  us«*d  for  transmitting  discrete  messages  have  been  studied  onlv  for 
the  ideal  case  when  the  sole  f*c"or  «prvl.g  to  distort  a  signal  heirg  re¬ 
ceived  is  additive  interference.  fur thermoi e ,  oriy  oiu  form  of  inter¬ 
ference,  which  is  expressed  as  a  stationary  random  process  with  a  normal 
distribution  of  probabilities  of  instantaneous  va.ues,  has  been  thoroughly 
invest  igated . 


In  actual  communication  channels,  alone  with  additive  interference, 
there  are  other  factors  which  distort  a  signal,  for  example,  fluctuations 
in  phase  and  amplitude  of  a  signal  (fading'/,  the  existence  of  an  echo,  etc. 
Along  with  the  thoroughly  studied  noise  interference  in  radio  channels, 
an  essential  role  is  played  by  mutual  interference  created  by  simultaneously 
operating  radio  stations,  interference  of  an  impulse  nature,  etc.  All 
these  hindering  factors  have  been  studied  in  the  general  tl eorv  of  communi 
cation  to  a  much  less  extent  than  norma!  noise  interference.  \s  a  result, 
there  is  a  serious  danger  of  applying  certa:n  theoretical  conclusions, 
which  have  enjoyed  wide  popularity  lately,  in  situations  fundamentally 
different  from  those  for  which  the  conclusions  were  drawn. 

One  sample  is  the  situation  existing  several  voars  ago  with  respect 
to  correcting  codes.  This  theory  was  intended,  until  recently,  to  applv  to 
a  certain  idealized  "discrete  channel"  in  which  there  exists  a  certain  pro¬ 
bability  of  incorrect  reception  of  a  transmitted  symbol ,  regardless  < 
how  other  transmitted  symbols  were  received.  Various  correcting  codes  were 
developed  in  large  numbers  on  the  basis  of  this  theory  which,  however,  did 
not  find  practical  application.  Only  lately  has  coding  theory  begun  to 
allow  for  certain  peculiarities  of  actual  communication  channels  and  this 
has  made  it  possible  to  devise  codes  to  increase  the  fidelity  of  a  received 
message,  not  only  theoretically  but  also  in  practice. 

The  purpose  of  this  book  i *  to  set  forth  a  modern  theorv  of  trans¬ 
mitting  discrete  messages  encompas- i nc  as  fullv  as  possible  the  various 
conditions  which  prevail  in  actual  communication  channels.  Micro  possible 
theoretical  results  are  reduced  to  formulas  for  engineering  calculations 
or  graphs  to  aid  in  obtaining  specific  reconmendat i ops  applicable  in  the 
design  of  system*  and  communication  etiuipment. 

fhe  great  variety  and  complexity  of  the  problems  involved  in  trans¬ 
mitting  discrete  messages  prevents  giving  full  treatment  in  one  to  all 

the  questions  posed  and  giving  complete  solutions  to  pronlems  which  arise. 
Specifically,  no  mathematical  exposition  is  gi'-en  lie  re  for  the  "classje.il' 
theory  o*‘  information.  fhose  results  o*  information  theory  which  are  re¬ 
quired  for  solving  the  problems  talon  up  ire  presented  /luring  the  course 
of  exposition,  sometimes  without  strict  conclusions  hut  with  reference  to 
sources  where  thev  can  'e  found,  further,  no  treatment  is  given  n  a 
number  of  technical  problems  sue1'  as  specific  enuirnrnt  circuits  or 
separate  components,  although,  where  possible,  at  ten  ton  is  devoted  to 
the  problems  involved  in  technological  feasibility  of  various  methods  for 
designing  items  of  equipment ,  evaluating  their  complexity,  and  .  •  t  •  r  t  ecb  - 
nical  problems  attending  implementation  tf  various  commun  :  c  it  i  op  <vst  cn-- . 

It  is  assumed  that  the  reader  has  Knowledge  ol  t 1  e  fund.amer.t  il  t  the 
theory  of  probability,  including  an  elementary  Inowledge  of  the  theory  of 
stationary  random  processes  (the  concern  of  a  correlation  function  and  its 
connection  with  an  energy  spectrum'.  Several  concept  s  in  mat  ’•  er.it  i  i  a  1 
statistics  will  be  explained  as  neede..  when  thev  are  i  nt  nvlu.  ••  ! . 
knowledge  o4'  other  sections  of  mathematics  needed  is  r  1  it  usua  1  •  \ 
in  courses  taught  at  higher  technical  s-w>,ii<-. 
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1.1.  Mess  i  n  e  •  ,  *>  i  o.-'a  !  ,  r  •’"nic  •  .  •  ‘  <  .n  rt  i-u.e  1  c 

Anv  message  is  cert  ai  n  t  el  in?  orr a  t  i  >•  ; 1  • :- 1 :  t  *''«  *  ,•>  t 

some  mater  i  a  1  system  which  is  ?  ran.  s- i  ?  ’  •>  .  h\  a  r.t.t  i<* .  1 1  >  -  •  : 

this  system  to  another  man  r  <  icv  i  oe'  *'  i»  ?■■  1  i :  .  i  r-  i  |v  has  "■  -1 

getting  this  aggregate  of  ::  formation  '  v  lit'  t  o'-. at  io»< .  ,J.  •  * 

material  system,  t  ('get  her  with  the  oi’servt  t  ,  is  the  ei'^.uv  •■on,.,e.  1  ■ 
order  that  an  item  of  information  he  -ransmi r ted  useful]',  it  '  ero'.'an 
to  employ  some  uhvsica!  process.  \  changing  phvsic.i  m.ipritule 
example,  current  in  a  wire,  electromagnetic  field.,  ;o'ir  1  w.ius  etc.'  re 
fleeting  the  message  is  called  a  signal.  The  aggregate  <■<  r-mtis  ;n*  raided 
for  the  purpose  of  transmitting  a  signal  is  ailed  a  cornr' ;  •  >*  •  n  true 

Here  he  "means"  is  unde rsto"1  !  the  ohvsical  rediutr  t:  w'  i.h  .  •  goal 
propagated  as  well  is  the  device  itself.  '  sign.:  i  >;  •  ecoi  \  <\!  a  re¬ 
cipient.  I<v  Innwing  the  law  ioini’g  message  and  signal  •'(  recipient  is 
able  to  determine  *he  information  entained  ,n  the  reshape .  '  :  •  •- 

not  known  ahead  of  tire  by  the  recipient  .  f  he  me-  ago  and  re  i  * 

is  a  random  process. 


Along  wit1  a  ■- ;  gti  i .  "g  '  ran  ‘-r  t  t  <  .1  'h  a  alee1  u 

other  random  proccs.es  o  •'  ar;  i  i  ■  ,*a  lie! 

The  presence  of  into*  ••  >  cuii  t  -  in  i  :r;»s  T-ert  i  i  im'  ;  ,  . 

tion  of  the  message. 

Ihe  communi  r  ‘  •  ch.a  cm  !  *  '-get  ;  % :  *  '■  ,:"e  a  re 

recipient,  •,  i  -  b  gj  •  -*r  ~orh  o’  >•’  •  *•  \  er*  :  •'  •  >  rew.  ,  ,*n 
res t ora t  i  t  of  mess  tg(.  u,ts.  i  >n  .  •■.<>!,  >,  c  ■ 

ra r i on  sve • em . 


i  r.io  t 


sometimes  a  •'  itmel  s  used  ’  *  i  >\  s>-  ;  t  -n*'  •-iti  r  t 
sources  to  sever.)  1  roc:*  ieri's.  ‘-u  a  channel  ;  «.  ill'  1 
channel  and  will  t<n  •••nsjdered  in.  r!;apte--  i  \ 


A  verv  general  diagram  of  a  communi  cat  i  on  v  v t  em  is  ct  owu  in 
figure  1.1.  Here  hv  t  ransrnn  !  t  i  •  g  device  s  meant  all  *'-e  ‘>.iu;-rent  iu 
to  convert  a  message  into  a  signal  and  i  e  ->j  i  i.v  device  .  *.  -’e  mt  -1  . 
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iVr  note  that  the  concept  of  "channel"  is  not  str 
example,  let  a  sjynal  In'  i  ng  transmitted  from  int 
pass  in  sequence  through  several  links  i,  b,  c,  .... 
represent,  for  example,  amplifiers,  cable  sections,  r 
electromagnetic  or  acoustical  haves  are  propncnt  ed ,  e 
of  all  these  links  can  be  called  a  channel.  Put  it  i 
consider  some  of  the  links,  for  example  ,  from  e  to  i, 
links  a  and  b  to  the  transmitting  device  and  link  k  t 
vice.  In  the  general  theory  of  common i cat i on  it  is  c 
channel  any  part  of  a  s\stom  of  c  unman  i  c.a  t  i  on  s!,!ch, 
"ions  of  the  problem  hoi  nr,  solve’,  is  :  j  i 

It  is  in  this  sense  that  we  u;'.  ur.deTs:  on!  ‘he  terr. 


i  C  t  !  v  ■. 


o  f  I  Tied  , 


nt  1  i  *  t  more 
1  ,  uh i ch  mav 


.  .  .  ,  ;  ,  i  ,  1  ,  uh  i  ch  mav 
ns,  re.’iur  ‘brooch  whiih 
ed  ,  et  •.  The  aggregate 
it  is  also  pose  ;'le  to 
t  o  i  ,  a  ch.innc  1  ,  i< s  i  gr.  i  nc 
k  k  t  ‘ 1  e  r*  --ri  v:  ry  -.ir¬ 
is  cop v er, :  en t  to  cal!  a 
;  ch  ,  accordin'  to  the  coidi 
o>-  updo"'  i  ra!  It*  '  .or cr 
r  o  rr-  '  ■ 1  a -'no  !  . ' 


1-  rom  a  mathemat  ical  point  or  .it's  *c  dost.  ••!>'«•  a  ch  ir.nol  meav  •  <> 


indicate  what  sign.  Is  can  be  deli  votl  re  '  t  s  intuit 
but  ion  will  *>e  of  :  robah  i  1  i  t  i  •  s  .  -f  a  si,;*  il  i*  :  s  • 
signal  at  its  input.  1  iodine  sue1  TrU-  - u  >n\er* 

signals  i  n  .a  given  channel  and  the  re  > . or  vers  i 

into  message  in  which,  ;n  i  ver'ain  sop'e, 

~'ir  messages  is  prmide!  :  s  *  he  gone-.'  ••  r 1  i 
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\"o  actual  material  s  vs  tom 
a  continuous  series  t.f  states  "owe  •• 

never  exhausts  .a]]  peculiarities  of  a  <* 
if  i  sere t  e  1  i  .  e ,  ,  finite  or  c  1 1  a  1  d- 1  >*  <■<•*  ' 

that  ‘ho  re<s,age  sour  r  is  1  ■  •.  •••*<■ 
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In  onlor  to  judge  whether  a  certain  message  source  is  discrete  or 
continuous  it  is  essential,  after  selecting  a  finite  interval  of  time 
of  duration  T,  to  consider  the  entire  set  of  messages  A  which  a  given 

source  could  create  during  this  time.1  If  this  set  is  finite,  the  message 
source  is  discrete,  otherwise  it  is  continuous. 

Understandable,  with  an  increase  in  f,  the  number  of  various  mess  iges 
■\  increases  and  this  can  create  a  discrete  source.  This  number  increases 

exponentially  for  all  sources  I’"].  Therefore,  if  interval  of  time  T  is 
not  limited,  set  \  is  alwavs  infin'tt  .  However,  tor  a  discrete  message 

source  it  will  alwavs  be  calculable.  This  means  that  all  conceivable 
messages  can  be  arranged  in  accordance  with  a  certain  law  into  a  series 
and  enumerated,  for  example,  for  a  source  creating  messages  in  the  form 
of  text,  written,  sav,  ip  the  Russian  alphabet,  >r  is  possible  to  sub¬ 
divide  all  possible  messages  into  groups  differing  in  the  number  of  letters 
in  a  message,  to  arrange  “hose  gr< uns  in  the  order  of  increasing  number 
of  letters,  within  emit  group  to  arrange  the  messages  in  alphabetical 
order,  and  then  to  enumerate  the  sentience  of  messages  obtained.  It  ‘"ollows 
that  such  a  message  source  is  discrete.  w.v  two  messages  from  this  source, 
if  they  are  not  identical,  will  differ  by  ,*  t  least  one  letter. 

A  device  transmitting  the  results  of  measurements  of  some  continuous 
magnitude,  say  atmospheric  pressure  at  a  particular  place,  provides  an 
example  of  a  continuous  source.  If  two  messages  from  such  a  source  are 
not  identical,  tl  ey  may  differ  from  one  another  bv  am*  amount  however 
small.  When  this  is  so,  no  matter  how  little  message  \  differs  from  !•’ , 
it  is  always  possible  to  have  a  certain  me*. sag'.  ('  which  will  differ  rrom  V 
less  than  from  B.  Such  a  set  of  items  of  information  forms  a  continuum 
and  cannot  be  enumerated.*’ 

However,  this  continuous  source  will  be  discrete  if  two  conditions 
are  imposed  upon  it.  first,  it  must  give  a  message  about  the  magnitude  of 
atmospheric  pressure  at  certain,  previously  prescribed  instants  of  *  i me . 

It  must  round  the  measured  values  orf  to  a  certain  accuracy  (say,  to 
0.01  mm  Hgl .  It  can  easily  be  seen  that  such  a  modified  source  is  discrete. 
At  the  same  time,  if  the  indicated  instants  of  time  are  sufficient lv  fre¬ 
quent  a  d  the  accuracy  of  approximated  representation  sufficiently  great, 
from  *.  practical  point  of  view  such  a  discrete  source  is  in  no  wav  inferior 
to  a  con'inuous  source.  Nevertheless,  resort  is  not  alwavs  had  to  dis¬ 
cretizing  or  uiant i ring  a  message,  for  example,  a  source  transmitting  the 

It  should  stressed  that  here  and  later  we  speal  of  a  set  of  mess, -ices 
sfic’*  a  source  could  create  ini  no?  of  actual  lv  created  messages.  1  rorr. 

*lv[v  so*  .iIv.tvs  message  is  -ealjcr!  in  practice.  If  a  certain  message 
I  ’  >"  1  *  ]  ;  nv  i  "  g  i  *  t  s  o  •  t  I  r  e  <*.  age  1  \  c  *  i  n  ,•  T  ,  is  ?rinsmit?ed,  then 

i  1  t  r  *  -e  «■  *,  >  ,-o  -  i  •  f  -  <>  1  •  •  n?  «•  r  a  ’  _  *  ’  ,  is  cons  ;  'ere 
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tlio  magnitude  of  acoustic  pressure  in  front  of  a  microphone  fin  telephone 
or  radio  broadcast i ng)  remains  in  most  cases  continuous. 

In  this  work  consideration  is  given  only  to  messages  created  by  dis¬ 
crete  sources  which  for  brevity  will  be  called  discrete  messages. 

Discrete  as  well  as  continuous  sources  can  be  subdivided  into  two 
tvpes:  sources  with  a  controllable  rat'-  and  sources  with  a  fixed  rate  PI. 
In  sources  of  the  first  type  messages  are  stored  in  recorded  form  and  are 
issued  on  demand  from  the  transmitting  (coding!  device.  In  sources  of 
the  second  type  messages  are  issued  at  certain  instants  of  time  which  are 
determined  by  the  source  itself  and  do  not  depend  on  the  functioning  of 
the  transmitting  device, 

The  text  of  a  telegram  which  is  to  be  transmitted  hv  telegraphic  com¬ 
munication  line,  a  phototelegram  blank,  or  a  perforated  tape  are  examples 
of  sources  with  a  controllable  rate,  'kany  pickups  in  telemetric  svstems, 
electronic  computers,  a  man  speaking  into  a  microphone,  or  a  nlav  trans¬ 
mitted  by  television  provide  examples  of  a  source  with  a  fixed  rate. 

Often  an  element  of  buffer  memory  is  inserted  between  a  source  with  a 
fixed  rate  and  a  transmitting  device.  If  the  capacitv  of  the  buffer  memorv 
is  increased  without  limit,  the  conditions  of  message  transmission  approach 
thosn  which  prevail  when  the  sources  have  a  controllable  rate. 

1.2.  Conversion  of  Messaqe  Into  ‘h'qnal 


The  form  of  a  signal  passing  along  a  communicati  e  darnel  is  deter¬ 
mined  by  the  physical  peculiarities  of  the 
and  the  receiver.  In  electrical  communicat 
to  a  current  in  a  conductor  or  the  intons  it 
acoustical  channels  it  is  the  sound  rressuj 
essence  of  a  signal,  we  will  consider  a  sot 
tain  function  :fti.  Argument  t  is  usually 
case  will  he  considered  here  although  ir  a 
another  meaning  (for  example,  the  coordinat 
message  on  paper!,  bach  signal  of  *his  sot 
of  argument  t. 

for  transmitting  information  with  tue 
to  establish  a  certain  mutual  relationship 
messages  in  set  \  and  certain  <,i;:nl«  '"Irt 
signals  form  a  subset  “  . 

General  lv  spealing,  tins  re  .-it  i  n<hir 
However,  ir  a  reasonable  designed  comrun i ,  at i 
at  least  one  direction. 
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often  is,  ambiguous,  this  not  precluding  the  possibility  of  valid  res¬ 
toration  of  the  message. 

Thus,  the  system  for  converting  a  message  into  a  signal  and  back  mav 
be  given  in  the  form  of  a  table,  that  is,  a  dictionary  wherein  certain 
signals  of  subset  Z  are  matched  with  all  messages  in  set  A.  In  the 

general  case,  if  time  T  for  message  formation  is  not  limited,  such  a  'ic- 
tionarv  would  be  infinite  in  size.  Hut  even  with  a  limited  time  T,  i  '-on 
set  A  is  finite,  in  most  cases  it  holdes  such  a  large  number  of  poo-, 1 o 
messages  that  compilation  of  such  a  dictionary  and  storage  of  it  in.  the 
form  of  a  recording  on  paper  or  in  an  electronic  memorv  is  inv  ractic.ible. 
Only  for  the  most  primitive  message  sources,  when  the  min' or  of  elements 
in  set  A  is  very  small,  is  such  a  dictionary  method  of  conversion  suitable. 

In  other  cases,  instead  of  the  direct  dictionary  method  of  conversion, 
use  is  lade  of  a  more  convenient  procedure  whch  amounts  to  partitioning 
all  possible  messages  in  set  A  into  a  sequence  o*'  several  "elements”  or 
"elementarv  messages"  or  "letters,"  which  form  the  finite  et  v  Hiving  a 
rather  small  number  of  elements.  hUch  pa  rt  i  t  i  on  i  ng  is  usu,  !]v  done  f\ 
the  message  source  itself  an.!  car  be  done  in  various  wavs.  l’r  will  rro- 
sent  several  examples. 

lxample  1.  let  a  message  measure  a  certain  seal  ir  magnitude  with  an 
accuracy  o*‘  •  .  dal  ng  <  as  unit',  it  is  possiMe  to  depict  even  result 
of  measurement  ;'v  a  *holc  number.  Tb  i  s  mmber  can  '>0  written  with  digits 
in  the  decimal  oi  any  other  svster  of  mincers.  Then  am-  message  which  :< 
the  result  of  one  neasuremen'.  or  a  seuuence  '  results  o‘  several  measure¬ 
ments  can  be  partitioned  into  ligits  in  the  selected  sv:tom  *  numbers. 

1 ach  digit  represents  an  element  arv  ne«s.,ge  'or  "letter"'  so  that  “he  se? 

X  (in  the  decimal  system''  cm  ;n  this  example  certain  1'  elements.  In 
several  cases  it  is  advisable  to  include  in  \  one  additional  elerenttr' 
item  of  information  ( senarat  i  ng '  indicating  t'mt  .«  given  result  o‘  reasu-r 
ment  is  terminated  and  am  item  about  another  result  ;s  '-eg inning, 

lxample  'ssuro  that  source  messages  can  'u*  expressed  in  -ords 

i n d.  recorded  in  >om.e  language.  Pier  a  letter  o *'  the  alphabet  <->•'  »We  given 
language  (after  including  in.  it  separators  Ketween  words  and  "wncMiiaf  i  '*> 
marls'  can  be  taken  s  an  elementary  message.  I?  would  also  o  poss  >-  j0 
to  tale  a  word  or  serterce  is  an  elementary  message.  'll  *h«-r  -g*  n)s 
-•  partitioning  lead  to  a  finite  -rt  \ ,  however,  rartiti  >r * -g  word  or 
sentence  is  in  nra-'ice  inconvenient  since  in  “his  case  >  w  j  ’  ;  cent  a  n  a 
verv  large  number  of  elements. 

lxample  ’ .  In  the  general  C3s<-  of  art'  'iscrete  source  all  ros'd-le 
messages  as  indicated  a*'ov  c  ,  *'orr  a  calculable  set  and  n-  >r  enure  rat  ed . 
The  la-,  in  accordance  with  vhic*-  enumeration  is  -erf  orm.rd .  can  hr  selcc*e  ' 
in  light  of  the  pecti  ’  i  a  *-  i  f  i  e  of  a  given  specific  sourer.  The  number  - { 
each  message  can  '*e  written  in  anv  number  svston  and  each  digit  >f  “hi  < 
number  talen  as  an  elementarv  -essage. 
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Wo  u,  cons  i  dor  t  he  'sasic  i  Ions  of  this  theorv  ns  nno livable  to  :i 
dis  ri'tc  source  emitting  n  series  of  elementary  messages.  Wo  will  trv  to 
find  :i  convenient  measure  of  the  quantity  of  information  contained  in  a 
certain  message.  The  principle  idea  i n  the  theorv  of  information  is  that 
this  measure  is  defined  not  bv  the  concrete  content  of  each  message  hut 
hv  the  fact  that  the  source  selects  a  given  element arv  message  from  the 
fini’e  set  X.  This  idea  is  justified  bv  the  fact  that  on  tit  is  basis  it 
has  been  possible  to  obtain  a  series  of'  significant  and  at  the  same  tire 
nontrivial  results  agreeing  well  with  intuitive  ideas  about  information 
transmission.  The  most  import  int  of  these  results  will  be  further  sot 
forth . 


\nd  so,  it'  a  source  nerferms  selection  of  one  element  arv  messif, 
s  -  1 . fror  alphabet  set  \;  then  the  amount  of  information 
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will  designate  this  conditional  probability  by  p(’x  x.l.  Then  the  amount 
of  information  letter  x.  will  be  expressed  by  function  :fp(x  x . ) 1  . 

K  r  1 

On  the  other  hand,  the  probability  of  selecting  a  pair  r  f  letters  i  , 
according  to  the  rule  of  multiplication  of  probabilities 

p >i,  |  >.'  n .  f  ' 

The  requirement  of  additivity  of  amount  of  i  nf  -r^a*  i  on  in  enlarging 
an  alphabet  lends  to  the  equation 

9  l/’O.'l  ;  r  [/’I :  1,’i  '*1 

?  |/’  i  '«>! 

l.et  tMx.'l  =  p  and  p(x,  x.i  =  ti .  Then  for  anv  ;  and  u  ■  ■'  p  •  I, 

i  1  i  - 

<i  •  11,  the  following  equation  must-  held: 

«i  r  1  ■ " 

The  cases  p  =  o  or  q  «'  are  excluded  from  cors;  ler-itien  '-ir.ee  is  i 
conseutience  of  the  finite  number  of  letters  in  t K <>  ilrhab-'t,  those 
eouations  indicate  that  selection  'u-  the  source  of  the  letter  pair  x.,xl 
is  an  impossible  event. 

I  quat  ion  i «  a  functional  euuut inn  !  r  >r  uh:  -'ode  ‘  1m:v*  pm 

:  can  be  determine!.  We  d  i  f  f°rrr'  i  at  e  ''cth  par’s  ,>f  <,:ui*i  >n  with 

respect  p: 

«, '  ( r  i 

We  i  ]  1  multiplv  both  sides  if  tue  etiuat  i  n  out .-  >i’’p  !  'm  •.  m,d  ir.rn  - 
dtice  the  o;uu!i’v  t'u  -  r,  ther 

/',  '>•  1  '.''i  •  l  .  1 

Ihis  o  mat  i  on  must  hot  !  fir  on  -'fO  '  v  '  11  and  anv  v<  r  •  p>. 

!  he  latter  limit,  i*  i  m,  (r  p'  is  an*  c  j  gn  *  -  inoe  «  i  *ve  euu.it  :  on  l.-P  i< 


In  essence  all  proba1- i  !  i  t  i  es  figuring  in  *  i r  .  ons  iderat  i  on  are  condi 
1 1  ona  5  since  they  depend  on  letters  preceding  x..  lJv  introducing  the 

desienttion  pfx,  1.1  we  opiv  stress  *'i  it  in  computing  :  '■  i  s  pro1' i1' i  !  i  t  \  , 

1  i 

we  must  consider  sole  ’ion  of  the  letter  \.  itself  as  well  as  t'-o  letters 
preced i ng  it. 


not  s  i  gn  i  I  i  cant  since  equa  t  i  on  ( 1  .  -I  is  svmmet  r  i  ea  I  u  i  t  h  respect  to  p  and 
r  and,  consequent  1  y ,  must  ho  mot  tor  any  pair  of  position  values  ot‘  ari’ti- 
ments  nor  exceeding  unity.  hut  this  is  possible  onlv  it'  both  sides  of 
(1.41  represent  a  certain  constant  inagn  i  tiule  k,  whence 

L- 

I'  /  i/n  1 .  r  *  /' 1  i  • 

I  nt  cgra  t  :  nr  the'  equation  obtained  we  find 

.,!/•>  Ah 

\v ’ >. < •  pe*  f  is  ;m  ar'':tr;irv  constant  ot'  integration. 

lormtila  (i-''1  defines  rite  class  ot'  functions  :  ('pi  express  i  nt»  the 

amount  of  information  in  the  selection  of  letter  x.  havinu  a  prohahilitv  of 

i 

p'x.l  -  p  and  'uatisfviny  the  condition  of  uMitivity.  'or  a  determi  na  t  i  on 

of  the  constant  of  integration  r  we  use  the  condition  expressed  above  in 
iccordance  with  which  a  previously  determined  message  element,  i.e., 

'wiving  a  probability  r  =  I,  contains  no  information.  It  follows  that 
•  1  1  =  whence  it  immediately  follows  that  f  =  0. 

\s  far  as  the  proportionality  factor  1  is  concerned,  it  can  he 
selected  arbitrarily  since  it  only  defines  the  system  of  units  in  which  the 
information  is  noisured.  however,  inasmuch  as  in  p  -  it  is  advisable  to 
••'.ake  k  negative  so  that  t  hr  amount  of  information  will  he  positive.  It 
is  sj  mp  lest  to  select  k  -  -  1  .  Chon  , 


Mien  tiiis  is  dene  a  unit  of  information  is  equal  to  that  information 
contained  in  an  elementary  message  having  a  prohahilitv  of  1  ’e  to  is  *  *i .  • 
natural  logarithm  base!  or,  in  other  words,  eoual  to  the  information  con¬ 
tained  in  a  message  to  rite  effect  that  an  event  has  occurred,  the  proba¬ 
bility  of  which  is  equal  to  l;e.  Such  a  unit  of  information  is  called  a 
nattira  limit. 

'■lost  frequently  we  choose  k  =  -1  lnd.  Then,  :  (pi  -  -nn'lnf,  or 

rl/'l  I..g  /,  |,,  1  (1  .Pal 

/■ 

With  such  a  selection  of  1  the  unit  of  information  is  called  a  binary  unit. 
It  is  equal  to  the  information  contained  in  a  message  that  an  event  has 
occurred  whose  probability  is  equal  to  1/2,  i.e.,  which  can  happen  or  not 
happen  with  equal  probability.  Sometimes  use  is  made  of  other  units  of 
information  such  as  decimal  units.  We  will  use  binary  as  well  as  natural 
units  for  amounts  of  information.  In  those  cases  when  the  selection  of 
units  docs  not  matter,  we  will  write 
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■t 
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know  inn  th.it  a  logarithm  van  have  any  base  us  long  as  this  base  is  retained 
throughout  tlu'  solution  of  the  problem. 

flanks  to  the  property  of  add  i  t  i  v  i  t  y  of  i  n'ormat  i  on ,  expression  fl.e'l 
makes  it  possible  to  determine  t  lie  amount  of  in  form:  ion  not  only  in  a 
letter  of  a  messnye  but  a  1  so  in  anv  message,  in  matter  how  long.  It  is 
only  noeessarx  to  take  for  p  the  prol'.u1'  >  1  i  tv  of  ■■•election  of  this  message 
•'ren  i  mom’,  all  possible  in  I  >  , ; 1  ’  t  of  :  re'  i ous 1 v  '-.elected  mess-o'es  . 

l.h.  Fntropv  and  Production  ot  a  fVss.iqe  Source 

In  const  met :  ng  a  thecas'  of  common  i  eat 'i  o*>  i '  is  not  the  amount  of 
information  contained  in  a  specific  messare  that  has  greatest  importance 
bit  the  average  (mathematical  expectation''  of  the  amount  of  information 
entained  in  one  elementary  message  of  the  source: 


II  i.f  ’  M  .  I 

Mere,  as  everywhere  in  what  follows,  the  heri  rental  line  indicates  mat  ho  - 
mat i ca 1  expect  a t i on . 

’I  he  magnitude  IKxl  char.ict  eri  res  the  message  scarce  and  is  tailed  the 
ontropv  of  the  source  with  respect  io  one  element  of  u  message. 

In  the  simplest  case  of  a  source  of  independent  messages  in  which  the 
probabilitv  of  selection  of  one  message  element  o>-  another  iloes  not  tlepend 
on  previously  selected  elements; 

II  i  ’ 1  ^  /  1  (  ;  -,,i 


Here,  '  is  the  s 

;:c  of 

t  In' 

source  alphabet 

am!  pix  1 

is  the  pro'uubj 

1  i  tv 

selection  .o'  the 

k  -  t  1;  i 

.• !  era 

•r.t  L  - 1  letter 

•  i  . 

I'sually  it  is  specified  that  entn'pv  charact  eri  res  a  yiven  tl  i  st  r  i  but  i  on 
tit'  prohaM"!  i  t  i  es  from  the  point  of  view  of  indeterminacy  of  outcome  of  test, 
i  .  c .  ,  indeterminacy  of  selection  or  one  message  or  another.  indeed,  it 
can  immediately  he  seen  that  the  entropy  is  equal  to  r.ero  when  and  onlv  when 
one  of  the  probabilities  p(xl  1  is  mum  I  to  unity  and  all  others  are  euua  1 

to  r.ero.  This  irdicates  complet**  let  erm  i  navv  of  selection.  I'ith  a  fixed 
sire  of  alphabet  '  tlie  entropy  's  a  maximum  when  all  p(x.  1  are  the  same. 

Then  p (x^ )  =■  1/7  and 


II 


max 


lr 


(  1  .  st 


In  this  case  the  degree  of 
tuition,  is  greater  than  in  the 


indeterminacy  of  selection, 
case  of  probabilities  whi  -h 


based  on  in¬ 
ane  not  eoual. 
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finally,  if  we  consider  alphabets  with  equally  probable  elements  bur 
with  iliffirent  sizes,  the  entropy  increases  with  an  increase  in  the  situ 
This  also  agrees  with  the  intuitive  idea  of  degree  of  indeterminacy 
of  selection. 

After  the  source  has  made  a  selection  of  a  specific  message  element, 
the  indeterminacy  which  has  existed  is  eliminated.  In  this  respect  the 
amount  of  information  contained  on  an  average  in  an  element  is  measured 
by  the  indeterminacy  which  was  eliminated  as  a  result  of  the  selection  of 
this  element,  i.e.,  by  the  entropy  of  the  source. 

Another  descriptive  interpretation  of  the  concept  of  entropv  as  a 

measure  of  "diversity"  m  messages  created  by  a  source  is  possible.  It 

can  easily  be  seen  that  the  properties  of  eiuropv  presented  above  agree 
completely  with  the  intuitive  idea  of  a  measure  of  diversity.  It  is  also 
natural  to  thins  that  the  amount  of  information  contained  in  a  message 
element  is  greater,  the  more  varied  are  the  possibilities  in  the  selection 
of  this  el emonr . 

We  will  now  define  entropy  for  a  more  general  cl  iss  of  message  source 
in  which  the  pro)  a  I  ility  .  f  selection  of  an  element  depends  on  which 
elements  wer*'  selected  earlier,  he  w:  !  ■  limit  ourselves  to  sources  in 
which  probability  relationships  are  expressed  only  for  elements  which  are 
not  far  removed  from  one  another.  1 ;  is  ins'  such  message  sources  which 
are  most  lilelv  to  be  encount e-ed  in  practical  application. 

i.->r  example,  :  :  source  emi.s  inf  oration  i  n  t  be  form  of  a  fox* 

writtin.  in  Mi"  I'ussi  ,1  ior  are  ,  •her'  language,  the  probability  of  occur¬ 
rence  r. t  a  pertain  ietr-o-  depends  strongly  on  se"ral  preceding  letters 

but  depends  almost  r  ‘  at  ail  on  that  part  of  the  t "Xt  which  is  far  re¬ 

moved  fr  or.  it  ,  sav,  I''.-  several  tens  of  ,%oi\|s  .  Indeed,  if  we  find  in  some 
"ext  the  combination  of  tin  letters  "rasprodi  lo..."  there  is  a  strong 
.  ass  i  b  j  |  j  ty  that  the  following  1  u  j  t ;  i>(.  "niye."  further,  if  the 

text  :s  ;\it  her.at  i  il,  afti>'  the  word  ■  ured" !  en  i  ve"  the  word  "vorn- 

v  it  nost  ev"  w  i  1  ’  •*robab|\  ‘'oliow.  !!ow  r  .  *!'e  probal  ■  i  I  i  t  v  of  occurrence 
of  particular  let  *  ers  or  word*--  in  i  «ucc-.  ed n.g  line  depends  almost  not  at 
ill  on  the  letters  written  at  beginning  o'  the  preceding  line.  bono_ 

what  more  extended  r  rob-j'-.  j  |  j  t  i  es  can  'u*  (until  in  poefrv  '.as  a  censeuucnee 
of  rhvthm  and  rhyme'1  but  even  h"re,  as  a  -lile,  t  b.>\  |o  not  extend  further 
"ban  epe  stanza. 

\nothet  evinnie  is  p’-oviued  by  a  suur.ee  which  me  o  uros  atmost'herie 
pressure  .t  a  particular  ;  •>:  nt  with  giv":.  rrec  i  s  j  «r  at  certain  interval".  o| 
*  ;n  tii  i  s  example  the  p>-,-d  d-  •  1  i t  v  *  i  es  bet  ween  results  o)  (>bsrrvat  i  ons 

a  i  e  extended  over  long  i  i.t  •  ’■•ca  1  ■  f  'ire  on  the  order  of  sever  a  1  da  vs  or 
wools  and,  consumer*  I  y ,  include  mam-  element  an  messages  (if  the  measure¬ 
ments  ate  per  formed  with  suf  -'j  c  i  ■•m  frequent v,  tor  example,  m-ry  hour"!  . 
However,  even  here,  attention  can  he  drawn  to  the  rather  long  interval  o! 
t .  me  (several  motif  hs  or  years'!  over  which  these  t  i  es  for  all  pi  act  i  al 
purposes,  do  not  extenl. 

in 


Martov  chain?  provide  a  mat iicrat  1  c  1 1  rciTf'iTtai  lan  i  '  rr^  i.’n* *- 
created  by  such  source?. 

■\  Markov  chain  o  f  the  n  - 1  h  order  s  1  ?e.i  :cr.  e  o  *’  dependent  tri*]* 
in  which  the  conditional  probab  i  )  1 1  y  of  i  certain  out  core  *  ”i  *•„,  •> 

trials  wlien  the  outcome'--  of  the  n  preceding  vials  are  1  nowr ,  doe?  n  t 

depend  on  previous  nut  cone?,  In  other  worl?,  when  1  •  a,  a, ...a  a 

!  .  n  n  • 

/’i  ','1  .  '  "  i  J-I\  !'  ■  v'  •.  i 


In  a  Markov  source  o*'  the  n-th  order  the  d  i ,-t  ri  'mt  i  n 


'ro1' a1'  i  !  i  t  i  e 


nr.v  A  does  not  remain  constant  but  depend?  o”  what  the  !a?t  r  letter?  !e- 

K 

t ermine  a  certain  state  of  the  source  fq  =  1,J . r1  in  which  the  pru- 

hahilitv  of  selection  of  the  I-th  letter  of  the  alphabet  i?  eon, a  1  ro  n  |>  i 

i  1 

'rhe  number  of  variou?  possible  ?oauencc?  or  n  letter?  '•.'it1'  a  sice 

of  alphabet  i?  equal  to  It  follows  that  tho  mim'-v  r  o!  various 

states  of  the  Markov  source  i?  finite  and  doe?  1  ot  exceed  ,n.  If  ’or  e.a  'h 

state  f  prohah i 1 i t i es  p  ( x. 1  are  given  and  it  is  Inown  which  state  defer- 

ci  n  h 

mines  any  sequence  of  n  element?,  then  the  pro1'.!1'  i  1  i  r  i  os  !'  of  each  of  the 

state?  f  In  =  1 . r'l  can  he  conput  e.i .  ’’or  seven!  add.  i  t  i  on  a  1  cond  i  t  1  on?  , 

M 

callod  ergodic  conditions,  which  are  met  for  all  source?  of  practical  in¬ 
terest,  there  exist  unconditional  nrohah  i  !  i  t  i  e?  pl.x^l  of  selecting  the 

1-th  elemental-’.’  message 
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The  expression  II  V  /’,  ■  \«U"  .  '.  represent  i  nr  the  mathematical 

A  I 

expectation  of  the  .amount  of  informt  ion  in  a  selected  element  for  a  source 

in  the  q-th  state,  may  he  called  the  entropy  of  this  state.  Ke  obtain  the 

entropv  of  a  source  (computed  for  one  element)  !'  in  accordance  with  (1.**) 

u 

!".•  averaging  over  all  possible  states 


//(’•!  ^  V  l\  /■,.’«  '  * '  k  ?,  /'jt 
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l.xprcssion  fl.”aj  is  a  particular  case  of  il.ll)  where  r  =  1,  i.e.,  with  ’’he 
only  state  of  the  source.  If  we  were  no*  to  consider  the  probabilities 
ties  between  message  elements  and  base  ourselves  on  unconditional  prob.a- 
!  i  I  i  1  i  es  p(.<  )  determined  from  f  1 . 11  ■  ,  then  for  one  element  we  would  take 

for  the  entropv  of  the  source 


II 
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In  JnfnrrMt  :  on  Thcor*  ;*  i  ••r.nr  !  •  .1 T  * ; w  t . »  “ 
existence  of  t’rrt'.i'- 1  1  •*  tie'  Vctrt*r^  r-*  -  t 


i  r 
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CAXtn.il  ent  rot"  M  log  go*-.  i * 1  c  *.  i  :*■  *  rr\«*"  A;.. v  i 

r,a  s 

for  character  i  :  5 nc  the  . 1 3 *■> h  i o t  <*t  »  r.ex-.ai-f  *-ourn-  1  t  •  h  i  ■. 
introduce  the  concept  *  *  3  r  -  i  *<  i*  t  -••  h:r  1  n  .  i  :>  >  ,•■.<■•'  -•  * 

(or,  ax  it  is  often  xt  ite.!,  re'i.ii'c  re  fun-i  m  • 


max 

from  what  has  been  said  above  it  is  clear  that  dixsimi'ar  pr<>baM  1  i  t  i 
of  message  elements  and  the  existence  of  probabjijtv  ties  between  close 
elements  may  cause  redundancy. 

We  will  present  a  simple  example.  I.ct  the  alphabet  of  a  source  consist 
of  two  elementary  messages  which  we  will  designate  A  and  R.  "hen  the  maxi¬ 
mal  entropy  of  such  a  source  achieved  with  independent  selection  of  A  and 
B  with  equal  probabilities  and  expressed  in  binary  units  is  II  =  log,  2 

If  the  elements  are  selected  by  the  source  independently,  hut  with  d if fen:/ 
probabilities  p(A)  =  0.3  and  p(B)  =  0.7,  the  entrop\  per  element  is 
H  =  -0.3  log,  0.3  -  0,7  log,  0.7  *•  0.52  +  0.3b  =  0.88  bits. 

In  such  a  source  the  redundancy  of  the  alphabet  is  equal  to  0.12. 

Now,  let  the  probabilities  of  selection  depend  on  one  preceding  clement, 
namely:  p(A|A)  =  p(B[B)  =  0.8  and  p (A 1 10  =  p(B'A)  =  0.2.  here  n(A  R]  in¬ 
dicates  the  probability  of  selection  of  element  A  on  condition  that  the  pre¬ 
ceding  one  was  element  R,  etc.  It  can  easily  be  seen  that  the  unconditional 
probabilities  of  both  elements  in  such  a  source  are  the  same  and  equal  to 
0.5.  This  source  has  two  states  determined  by  the  last  selected  element  and 
both  states  have  probabilities  epual  to  0.5.  Then,  from  (1.101  we  obtair 
II  =  -0.5-0. 8  log,  0.8  -  0.5-0. 2  log,  0.2  -  0.5-0. 8  log,  0.8  -  0.5-0. 2  log, 

0.2  =  0.722  bits.  The  alphabetic  redundancy  caused  by  the  probability  ties 

in  this  source  is  r  =  0.278. 

x 

We  will  now  consider  the  case  when  there  are  probability  ties  and  the 
unconditional  probabilities  of  elements  are  not  the  same.  Let 

p(A\A)  0..1.  p(B|,1j -0,7,  n(A  |D)  0,1  &p(B|b)-0.9 

It  is  easy  to  compute  the  unconditional  probabilities'  which  prove  to 
be  p(A)  =  0.125  and  p(B]  =  0.875.  Such,  obviously,  are  the  probabilities 
of  two  possible  states  of  the  source.  From  (1.10]  we  obtain 

'For  this  we  may  use  the  formula  of  complete  probability  p(A]  =  p ( A 1  r> ( A  1 A 1  + 

+  [l-p(A) ] p (A | B)  and  solve  the  equation  obtained  with  respect  to  p(A] . 
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!•  -  log,  log,  ».-]  -  (o.i  ior0  n.i  + 

•  *  1  !or,  o.o]  *  p.';’  ?Mpnry  units  an!  the  =  0.48. 

i  >r  -  >n\  practical  proMons  sources  which  emit  messages  in  the  form 

•  \  t<*»r  written  in  sore  language  arc  of  interest.  Specifically,  for  the 

u<pm  m  Imguage,  considering  the  nurher  of  letters  in  the  alphabet'  to 

V  we  have  -  lop,  a2  -  8  hinnrv  units, 

n  a  x 

If  w c  c  insider  tlie  unequal  probabilities  of  occurrence  of  letters 
a  text  and  the  dependence  of  these  probabilities  on  previous  letters 
uvordinp  to  data  provided  by  various  authors,  the  entropv  for  one  letter 
lies  between  the  limits  of  1  to’ 2.5  bits.  Such  a  groat  spread  in  results 
is  due  to  the  difficulty  of  considering  all  probability  tics  spread  over 
a  large  number  of  letters  in  sequence,  furthermore,  the  magnitude  of  the 
entropy  depends  in  certain  measure  on  the  nature  of  the  text.  Rased  on 
these  data  the  redundancy  of  the  Russian  alphabet  lies  between  the  limzes 
of  0.5  and  0.8.  Apparently  the  second  number  is  closer  to  actuality.*' 

Data  close  to  these  have  been  obtained  for  the  alphabets  of  many  other 
languages . 

The  entropy  of  a  source  defined  above  for  an  element  in  a  message  de¬ 
pends  on  how  the  message  is  divided  into  elements,  i.e.,  on  the  selection 
of  the  alphabet.  However,  entropy  possesses  the  important  qunlitv  of 
additivity.  Let  a  message  with  a  size  of  alphabet  7j  have  an  entropv  per 

element  of  II  (considering  all  probability  characteristics!.  We  will  en¬ 
large  the  alphabet,  considering  each  sequence  of  any  n  letters  of  the  pri¬ 
mary  alphabet  ns  one  element  of  the  new,  secondary  alphabet.  Obviously 

the  size  of  the  secondary  alphabet  is  %  =  We  will  show  that  the  en¬ 

tropy  for  one  element  of  the  secondary  alphabet  I!-,  is  equal  to  nll^.  From 

the  definition  of  amount  of  information  it  follows  that  in  a  certain  spe¬ 
cific  clement  of  the  secondary  alphabet  there  is  iiis1-  r.s  much  information 
as  there  is  n  elements  of  the  primary  alphabet  included  in  it.  The  amount 
of  information  in  one  specific  element  of  the  primary  alphabet  :  is  a 
random  magnitude  assuming  various  values  for  various  elements,  The  amount 
of  information  in  an  element  of  the  secondary  alphabet  I  is  the  sum  of  r 

In  the  number  of  letters  in  an  alphabet  a  gap  between  words  must  be  in¬ 
cluded.  Tn  this  case  1  -  52  if  the  hard  and  soft  signs  are  considered  to 
be  one'  letter. 

•  It  must  be  remembered  that  these  results  pertain  to  sources  which  give 
the  text  the  form  of  comprehensible  Russian  sentences  united  by  a  certain 
content.  If  Russian  letters  are  used  as  symbols  for  certain  events,  know¬ 
ledge  about  which  is  given  by  a  source,  the  entropy  for  a  letter  must  be 
computed  based  on  probability  characteristics  of  the  source  and  can  have 

anv  value,  up  to  I!  =  5  hits. 

mn  x 


-  1  *J  - 


random  magnitudes  : 


The  mathematical  expectation  of  magnitude 


r . n ' 

<!  ,  equal  by  definition  to  I!.,,  as  is  known  [11],  is  equal  to  the  sum  of 
mathematical  expectations  of  the  terms  of  ;^(h  =  1  ..... n d  and  since  each 
of  these  is  equal  to  11^,  then 


//--«//, 

IVe  will  determine  the  redundancy  of  the  secondary  alphabet,  r 
The  maximal  entropy  for  an  alphabet  os  size  ^  is  equal  to 

l*2max  ^’4  I:  n  log  lt. 
whence,  in  light  of  (1.1a], 
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from  expression  (1.4)  it  follows  that  the  redundancy  does  not  change 
when  the  alphabet  is  enlarged. 

We  will  point  out  that  in  enlargement  of  an  alphabet  the  mutual  pro¬ 
bability  ties  among  message  elements  become  weaker.  If  the  magnitude  of 
n  is  so  selected  that  it  greatly  exceeds  the  range  of  action  of  the  pro¬ 
bability  ties  in  the  primary  alphabet,  the  probability  ties  between  the 
enlarged  elements  can  be  ignored.  Inasmuch  as  the  redundancy  does  not 
change  in  the  process  of  enlargement,  it  must  be  almost  completely  deter¬ 
mined  by  the  nonuniformity  in  the  distribution  of  probabilities  of  the 
elements  in  the  secondary  alphabet.  Thus,  the  operation  of  enlarging  an 
alphabet  can  serve  the  purpose  of  "decorrelation"  of  the  elements  in  a 
message,  i.e.,  the  purpose  of  eliminating  mutual  probability  ties  among 
them. 


For  sources  with  a  fixed  rate  the  productivity  is  an  important  charac¬ 
teristic,  productivity  being  the  average  amount  of  information  emitted  in 
a  unit  of  time.  If  on  the  average  each  elementary  message  occupies  time 
T,  then  the  productivity  of  a  source  i • 


//'(.vi 


//(.i 

/ 
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If  messages  are  transmitted  in  a  system  of  communication  from  a 
source  with  a  controllable  rate,  the  average  time  T  consumed  in  the  trans¬ 
mission  of  an  elementary  message  is  determined  by  the  transmitting  device. 
In  this  case  the  magnitude  II' fx]  determined  bv  expression  (1.151  should 
be  called  the  productivity  of  the  transmitting  device.  The  difference 
between  these  two  cases  lies  in  the  fact  that  the  productivity  of  a  source 
with  a  fixed  rate  may  not  lie  changed  in  designing  a  communication  system 


while  in  the  case  of  a  source  with  a  control]. '.v  rate  th<-  ;  -  ■  !t:  t.\.*. 
of  the  transmitting  device  i'  selecte1  l-v  t  hr  levicm  r  m  accord  it  <  -  • 

the  various  technological  am!  economic  demand*,  made  or  the  moit 

It  can  casilv  he  seen  that  the  pr'duct  ivi  tv  of  a  *  >ur  <■  •  >t 

change  in  the  operation  of  enlarging  an  alphabet. 

1.5.  Interference  and  Distortion  in  a  Channel 

In  channels  signals  are  transmitted  in  the  form  of  cer"t:n  •roes  . 
of  finite  duration.  The  sequence  of  message  elemen’*  «  i-  v  -t".  er* 
a  sequence  of  code  symbols  y.  do  each  code  'vr-bol  v  corresponds  a 

tain  element  of  a  signal,  i.e.,  a  certain  function  : r  f  ‘  ,c‘in*'!  it-  a 
finite  length  of  time  (or  a  particular  set  of’  such  funct  ion«  .  If  th. 
signal  at  the  output  of  a  channel  represent'  the  same  function  : i t )  a' 
was  delivered  at  the  input,  it  would  he  possible  with,  complete  cor.fi  lence 
to  restore  at  the  output  the  transmitted  sequence  of  code  svrlols  and  then 
to  decode  it,  i.e.,  to  restore  the  transmitted  message.  Ihe  same  would 
hold  if  in  the  channel  there  were  only  regular  reversible  di sr ort i on* , 
i.e.,  if  the  signal  at  the  output  of  the  channel  c'ltl  represented  function 
of  the  signal  at  the  input  z'(t)  =  ffzftll  and  if  there  were  an  inverse 

function  f  ^[z'(t)]  =  z(t)  which  would  permit  restoring  t ho  transmitted 
signal  exactly. 

In  actual  channels  there  are  irregular  distortions  along  with  sue 
regular  distortions,  as  a  result  of  which  the  mutual  1 v  unamhi  -nous  cor¬ 
respondence  between  signals  at  the  output  am!  the  input  of  the  channel  is 
disrupted.  The  aggregate  of  all  reasons  causing  i  tidcf  i  n  i  teno<s  in  the 
signal  received  is  usually  called  noise  ot  interference.  Hie  term  "inter¬ 
ference"  is  also  used  in  a  narrower  sense  as  the  aggregate  of  voltages 
arriving  at  the  input  of  a  receiving  device  along  with  the  signal.  ‘Mich 
interference  is  added  linearly  with  the  signal  and  therefore  is  often 
ca 1 1 ed  addi t i ve . 

Along  with  additive  interference  in  actual  channels  there  is  to  Ip- 
found  nonadd.it  ive  interference.  It  amounts  to  random  distortions  in  a 
signal  caused  by  the  fact  that  the  parameters  describing  the  carrier  of  the 
signal  fluctuate  in  the  process  of  transmitting  the  message,  i.e.,  the 
mode  of  the  function  z'(t')  =  ffc(tl]  changes  irregularlv  over  time. 

On  the  basis  of  observations  of  various  actual  communication  channels 
(specifically,  various  radio  channels)  the  relation  between  the  signal  re¬ 
ceived1  z(t)  and  that  transmitted  can  be  represented  in  a  more  general 
form  as  fol lows : 


‘We  will  call  the  received  signal,  for  abbreviation,  the  total  signal  which 
is  to  distortion  in  t lie  channel,  and  additive  interference. 
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tion  of  its  own  decision  systems  ami  a  1  ■' <  each  of  thorn  in  i  certain  < t-r  ; 
is  optima!.  Other  nos •••  i  b  1  e  methods  of  determi n i no  cost  lea1  *  \  iri  'iw 

decision  systems  which  ire  also  ortimal.  "v  cost  becomes  fvc1’  nav  >•- 
determinate  in  those  cases  whet;  a  message  is  not  as  soc  i  a  t  >'d  wi*h  a  au.in- 
titativo  measure .  This  greatly  Mnders  dot  ormi  nat  ;  on  of  the  !•- 

oision  system  in  the  general  case. 

In  manv  cases,  it  can  he  considered,  hosed  on  the  mature  v  the  use 
of  a  communication  system,  that  any  error  in  message  recent  ion  entails 
the  same  degree  of  undesirability,  from  this  point  of  view  the  cost 
should  he  considered  the  same,  i.e.,  equal  to  ]  ror  a!i  :>air<  iv.,v  i 

if  i  £  i  and  zero  wlien  i  =  j.  With  such  an  evaluation  the  average  ?is| 
i  s 

i  i  i 

C.1V  V  \’  /;(.v,  )p(:\ l  v.  I  ■  V  (I  —/>(.■',  ,a,)|-  (  '•  ■ 

r~i  /  -i  t- 1 

<0/ 


'Here  it  is  assumed  that  x .  corresponds  to  the  number  i. 

i 


U\L-^,A  x.a 


Bur  this  ex"ress  i  on  nv’n'':i'nrs  not1' ini’  c*  1  t  h  :i  n  comp  1  etc  p  ro*  ;i  - 
>'ility  of  incorrect  reception  or  :i  message  element  in  a  decision  svstom 
tl.]‘i'l.  I'hus ,  the  criterion  o*‘  minimal  risk  with  the  same  evaluation 
of  all  errors  amounts  to  the  criterion  of  minima!  complete  nroh.nb  i  1  i  t  v 
of  error  or,  ns  it  is  usual lv  called,  the  criterion  0f  the  ideal  ob¬ 
server’  . 

It  can  easily  he  determined  t'ou  a  decision  svstom  must  )<<«  arranged 
for  it  to  provide  a.  minimum  of  complete  probability  o‘‘  erroneous  recep¬ 
tion.  Obviously  the  com.pleti>  proh  ab  i  1  i  tv  of  error  will  he  minimal  i  r 
t!te  decision  system  provides  for  a  mini -urn  or  erroneous  reception  with 
each  siitnal  received. 

let  signal  r’itl  arrive  at  a  reco  i  v ;  nr  device.  ,-or  anv  letter  x. 

of  the  source  alphabet  if  is  possible  to  determine  the  a  posteriori 
(  inverse!  probability  tl.l^.  he  i-.*  ill  assume  t'uat  t>’o  decision  system 
assigns  the  signal  to  the  subset  r.j  .  ''•en  the  "rehab j 1 j tv  t'wat  this 

signal  wi  i  !  be  received  correctly  amount'-  to  iv't!'.  ire  other  than  the  a 
posteriori  prohd'jijty  t'lx,  r '  i  .  I1'  there  ;s  in  ‘he  alphabet  a  certain 

r 

other  element  x  for  which  nfx  p'x,  r’1,  f^en  it  would  be  possible 

n  1  n  k 

to  increase  the  probability  of  correct  reception  of  signal  '  '  ’  '•  'ani, 
consequently,  to  decrease  the  proh. dm  ’  :  t  v  or  error'  ’v  chang i re  the  de¬ 
cision  svsfer  so  that  tit  is  signal  is  assigned  to  subset  r '  ,  rrom  this  it 

•  n 

Beijows  fha‘  the  minimum  probability  o'*  error  in  the  reception  of  t1’.- 
given  signal  z'lf!  tales  place  in  ‘hat  case  when  it  is  inter'reted  as 
that  message  element  x,  which,  has  *he  g>  >ates»  erohaHlitv  "i  x,  M . 

r  \ 

Inasmuch  as  this  pertains  to  anv  of  the  signals  received,  the  decision 
system  based  on  the  criterion  or  the  ideal  observer  imounfs  to  that  h.-md  - 
down  of  the  set  of  signals  received  wherein  to  subset  ’'elorg  all 

signals  which  differ  in  that  for  them  a.  posteriori  prohabjiitv  pc  y 

is  greater  than  er  equal  to  r’u-  probability  or  anv  other  message  element 

/»('*!•''*);  -/)(v..|.-'»)  (i  /  k) 

In  manv  cases  it  is  relatively  ease  to  build  sue!',  a  decision  system 
in  a  receiving  device. 

The  probability  of  error  with  an  optima!  decision  system  ’wised  on 
the  criterion  of  the  ideal  observer  depends  onlv  on  the  properties  of 


•This  criterion  is  often  called  the  1  ‘•'I'nilov  criterion  inasmuc1,  is 
V.  A.  hotel  'nibnv  was  the  first-  ro  mi  it  in  lO.te  in  devising  i  theory  '><’ 
potential  resistance  to  interference. 


the  channel  which  arc  determined  hv  interference  and  characterizes  the  so- 
called  potential  resistance  to  interference  of  the  enmrun i cat i on  system  f?1  . 

Instead  of  comparing  the  inverse  probabilities  nix.  r 1 1 ,  it  is  pos¬ 
sible  to  comr-are  the  product  pfx.l.lz.'  x.)  which  represents  r n e  numerators 

1  i 

of  the  expression  for  a  posteriori  probability  accordinr  to  the  Haves  for¬ 
mula  (1.1P),  Indeed,  the  denominator  in  11.  If  '  with  anv  given  z’  is  a 
constant  magnitude  which  does  not  depend  on  x. .  Therefore,  inequality 

1 i . do)  which  characterizes  the  decision  system  is  equivalent  to  the  in- 
equa 1 i tv 

(VfcJ  'i  /M  \  ,  1  W  I .  *|  V  1 1  (//•.' 


l 


•n- 


The  ratio  in  the  left  part  of  this  inenualitv  is  called  the  liveli¬ 
hood  ratio  for  x,  with  respect  to  x. .  The  decision  system  fnr  the  criterion 

1  i 

of  the  ideal  observer  can  ’'o  describee1  thus;  sien.nl  z’  is  assipned  to 
subset  z£  if  the  likelihood  ratio  'or  x^  with  respect  fo  all  x.  is  lo'i'er 

than  or  equal  to  a  magnitude  which  is  the  inverse  rat:o  the  a  prio:i 
probability,  he  will  note  that  other  Haves  crP^ria  dso  (with  a  varvine 
function  of  cos’)  can  bo  reduced  to  a  comrarisrp  of  lilelibood  ratios 
analogous  to  ineuunlity  f’l  ,  d-P  ,  with  the  iMf'erence  -'-it  !n  tKe  :'ght  part 
of  the  inequality  instead  of  ratios  or  ,i  priori  'am1'  a1,  i  1  i  t  i  es  tl'.i're  are 
other  numbers  ilependent  on  i  and  1.  and  deterr:red  i<v  the  cost  function. 

If  the  a  priori  probabilities  of  all  x.  ire  t’’e  same,  r''e  right  p n r t 

of  inequality  ll.d-P  is  euual  to  unitv.  1  n  sore  cases  it  is  assured  to  V 
equal  to  unity  even  if  the  a  priori  probabilities  are  net  tKe  same  or  i  1' 
they  are  unknown.  The  criterion  thus  obtained  is  called  tin'  criterion  o‘‘ 
maximal  likelihood. 


1 

i 


l\'e  will  consider  a  verv  simple  example  to  illustrate  the  criterion  of 
the  ideal  observer.  I.et  the  alphabet  o'"  tlio  source  contain  onlv  two  letters 
A  and  H  and  let  the  signal  received  z'lt'  ’-p  describee!  a  single  scalar 
parameter  (i.e.,  current  in  a  line''  which  will  also  bt>  designated  z1. 
figure  l.-t  depicts  curves  of  p  (A)  ,.  (z  '  •  A)  and  p(!n  z'  IP  which  represent 
conditional  probability  densities  when  transmitting  letters  *>  and  P  res¬ 
pectively  multiplied  by  the  a  priori  probabilities  o*'  these  letters.  U'her 
z'  •  z  ^  the  likelihood  ratio  for  P  with  respect  to  '  is  greater  and  when 

z. '  •  Zp  it  is  less  than  p|P  plP).  -'wording  to  the  criterion  of  the  ideal 

observer  the  entire  domain  of  z'  is  brolen  down  into  the  two  subsets 

(in  which  are  included  all  z'Tz.P  and  7^  (ir  which  are  included  al’ 

■  z^l  .  The  point  z. '  -  z^  can  be  assigned  to  anv  o''  t'p'  subset-*.  The 


-  dP  - 


complete  p  roh.ah  i  ]  i  t  y  of  erroneous  recent  i  on  of  1  li't  t  cr  i‘  euua  I  in  the 
cross-hatched  area  in  t  ho  fillin'.  indeed,  t  !i  i  s  area  is  I’liua  I  t  ’ 

*\  * 

^  />(/•)•••(  ■',/•  i  '  ’’  !  \  / M  ',-'1  'I  'h/  ’■  1 1 . 

-‘ci  *  ‘  - 


Hu'  first  integral  represent  <  the  proh.ih  i  !  i  t  v  that  letter  !’  mk  trails 
mi  1  '  ur.  :  <  i  ecu  '  r '  appeared  in  area  i.e..  : 'ie  "robah  i  i  i  t  v  nf 

.  •  e  'p ’  i  'P.  of  '  !•<!.•  id  ■  •  <  !•  ij.  1  ;  f r  <i\  ’■  1  '•’••••  i  !  ♦  '•••  ** »-<  'm 

I’ i  1  •  n  ’  roneous  reception  nf  H  instead,  o<‘  t.  I'  *  i  iv  i  nf  valuer  1 

•  ’  i-r  into  MilKi'p;  "*  an  I  ",*  i  ;•  iivd'cr  u  iv  ,  i.e.,  *  v  m  lrct  :r" 

\  !' 


.•  j  ’  ■  ead  nf  the  "threshold"  then  the  pr  -’m1  i 

ree>p"ie:  *  \  irstead  of  F  decreases  and  t1'.  *> ri'1' i  !  • 
ception  ■:  instead  of  \  increases.  However,  the  or" 
nf  •rroneous  reception  increases  fv  the  mamifude  C  *h 
the  darkened  triangle. 


!  i  *  '  .  ■  1  >>  •'  rnpe.  p|< 

•  v  *'  c  r rnnei  s •-  !••>  - 
1  e  t  e  i'  r«'h ah  i  I  i  ’  v 
e  tre.i  shown  '  '• 


figure  l.b.  Graphic  Definition  of  a  Probability  Mistake. 


Application  of  the  criterion  of  the  ideal  observer  is  \<m-v  "at  ura  1 
since  tlie  optin.il  decision  svster  leased  on  it  "rovides  'Mr  t’'e  lets*  pos- 
s  i  h  I complete  prehahilitv  o‘‘  erroneous  reeeption  o'-  a  "’ess.n"'  » n  ■  ’ ,  om  • 
serpienflv,  the  greatosr  pro*\d' i  I  i  t  v  o*'  error-'roo  ropep*  i  v  o'  •  Mp  seguerc 
of  elements  const  i  tut  i  nr  the  message.  below  we  will  present  several  other 
conclusions  in  favor  of  this  p'iterhm.  However,  cases  i r"  possible  ldM.p 
the  result  of  applying  the  crit  rion  of  the  ideal  observer  contradicts 
stood  sense. 

for  example,  let  the  alphabet  of  the  'ource  contain  two  element  irv 
messages  A  and  H  which  arc  selected  i  ndependent  1  v  with  "rehab  i  1  i  r  i  es 
nf-V)  -  n.nnu  an(]  P(it)  ^  n.oni 

We  w i 1 1  consider  two  variation  of  the  decision  svster.  In  the  first 
variation  the  set  of  signals  received  ~ '  is  broken  down  into  subsets 

and  A p  so  that  p(A  ~p  =  pfii'l'.^A  =  0.999  and  pfA|Z^1  =  =  0,001. 

When  this  is  so  all  messages  are  received  with  a  proh.abjijtv  of  erro’*  o' 
O.ooi .  |p  the  second  variation  of  the  svstem  the  entire  set  of  signals 


-30- 


In  !  i  s  c.K''  ill  s  i  »•- 


roc  c 

i  veil 

7. 1  is 

taken 

as 

7.  ^  si  lire  sp 

'  "P  ^ 

einpt 

v  .  1  n  t  h  i  s  r  i 

^  .  * 

n.t  1  s 

will 

l-e  re 

re  i  ve 

d  as 

!iiess,i|ip  \. 

t  hus  , 

'  w  i 

11  '-e  leceived 

i  n 

».  ;  i  S  c 

s  cor 

rer  t  1  \- 

and 

It  al 

wavs  inrorri 

•rt  1  v . 

'"-vi 

'-us  I  \- ,  w  -  t -a: 

,u 

"dec  i  <  i  mi  s vs  rep-" 


/m/' 

,1') 

ny  ^ 

|:  ' 

i 

and  '  i 

(7  •  |.li 

/■ « / 1  |  i  11 

md  the 

pi'ol-al- : 

i  1  :  t  -•  o 

rr 

■ror  is 

r<\ u. 

1 1 

t  - 

/• 

/ 

(■ 1  1  /’!•' 

i  .  i 

.  <■ 

i  /  1  ‘ 

:  ' 

*  '  i 

i  >• 

-ip.  tap  f 

■oint  o 

f  VI 

fl.  i’t'  ' 

f  l'.r 

■  r  i 

*.*»•'  » 1 

il,, 

■  idp.ll  ’sp." 

f't 

, 

serond  : 

-a  t  t  ern 

is  closer 

t  opt 

:  r  i  1 

i  n 

a  '-T'lich 

,  l,  •  » 

"  !'  -V  1  di  -s  *'(>>' 

a  It's 

sp  ! 

-mp ! p  r i 

,  .M-ei-  |i 

•  i  1  i  t  v 

c  *  V 

rror  * 1 

'  ii^ 

•hr 

■'  '  -s  • 

.  I’ll? 

,  '-P  »hp  .-t'-e: 

r  h  ii  1 

• 

!  s  (|U  i  *  I 

a  clear 

that  u 

r-  i  n  r 

the  s( 

Vi'P< 

i  , 

a  r  i  a  f  • 

.-I!  i-*'  t 

a,  .«.  -j<:  • 

■vs  f 

i  •. 

mean  i  n  ,• 

less  « i i 

tee  :  f 

no*  r 

i  vr 

IIP' 

d  oil*  1 

1  ’■  i  ri'-s  i rp  t 

flip  r 

t  fp.l 

ul’i  li-  t  hr  t'i  r«  t  v.i  *•  i a  r  i  on  ,  I !  •  'a -a  u  i  ’ 1  !:•*!■  .T  r ■  i ;  ’  t  v  ,  d»  s  ■  '  --os 

m'-Ip  ’ii  u  ■  •>:  •• .  •  c;  v;  -)  j- ,  i  •:  •  »i :  >  •  >  . 


^  i  K' 1 '  .i  cor.  t  r  i  i :  -  *  j  n"- 

.•  -ed  spnsp  arosp  i  cor  sf, pier 

.  rv  iti’  i  pri  nv  i  p  re1-, d  'lit  • 

t  h"  •  s t  o t'  ,i !  1  p  r rn rs  •  hp  s  i”>  . 

I  ■  C>-  I’d  i  I- 1’  *  I  I  ,  I  ■  I  j  •;  1  y 

I  '  l'  1 1  !  ■>u  •  p .  ' rive’  ;•••>• 

;  '  f  o  rr  1 f  :  1  -p  f  r  i  !>  «r  •  *  f  --d  T  ■'  i  c  r  -  ■  ! 


*  •  '  1  .  !  t  '.v  '  *  *-  SI  ’  1  -It  1  ’’ 

■.  , •  ;  i  •  I,  i  v  j  p>\  cor  s .  >!»•■•• 

!  P  f  l-p  in  *'  •'  i  *  i  mi  i  >’  1  i  :  "■  1  1  " 

i  •  <•••'•  .  •  * 1  r  ’  r  *  ’  i  •  :  'll  c  nt  i :  i 

, .  :  .  .  -  ;  .  ,,  !  I  , i:  i  ;  .  , .  „  .  i, ,, 


If  ‘i'li'ii!  1  p  *  f  hour1,  *  *hr  •  'a  •  i  p.i  !.-  \  •'  vv  spn  t  <■.'  ;  s  . .  •  •  ••  t  ■ 

t'i"  cr  i  -eri  i’P  .'!  'hr  idea  I  v.  1  •••  -  r-.  ‘  *  t  •  i  -  t  •  c  •  ’  •  i  ;  . 

.  •  ,  v  m  >«  v  • | ♦  '  sc  ;  >>  ••  •-I'pr  .-r  !<•  s  i  r?  i  t  :  :  i  ’  s  :  '  >;  t  ’  ■  \  n  u1  ;  r1  • 

t  r  i,!  u-f  'o  1  < i’ pi s v  .  ' 1  i •  * «  f'o r< • ,  t  '■  >■  ••  <■ !  >•  •  •  <•  , -  ,  si  , . ;  '  t 

”  i  * !  •  •  ir:  !  i  r'r  rt  ?">•  p  •  ■  c  u  I  i  i  r  i  * 1 1  -  ■  •' 

i  \y  vlj-irv  pi'prupi  :  r  ;  -n  >.v-f  er-s  t  *•« 

'n  od  !-  pas*  ’I'fn  op  i  '-n  f  .  ‘  i’0(’ Pi! :  t'r  *  ’  ‘  'i :  < 

i <  - ;  k1  n ^  *  In-  j.  i  rp.  i  1  iva1  i  *.  c  i  -  ’  1  *  ’ 

‘  '  I 

-  i  i . , 

hlv.int  u;o  n)’  t  hs  <  iti  fci"  ’ii  •  ^  th.it  if  "nt  ri’imi  r<-  i  pi>i<  i  «*< !  ri* 

thi‘  i  priori  prohat'i  I  i » i  «>•;  <>t  "-f.«..i  .•••<  .  It'  th«  .i  priori  pro''  i'>  i  !  i  -  i  i";  ,  >' 
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In  all  rasp*;  Ip-low  whom  nof'-inr  to  fho  ror.fr  a  r\  i  *■■  st  iti-.!,  wp  rill 
use  tlu*  criterion  of  maximal  1  ilol  i  hood. 

• 

In  somi-  rasps  the  s  i  )fn  1 1  rnrci\pd  dpt-rnds  not  onlv  <-n  -i-i'  romr-nni  r  a  r  i  -n 
t  ransmi  t  •  pd  and  i  nt  or  fp  retire  ’uf  also  on  c-ne  several  uni  nowv  "iraroters. 
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Thu*,  the  amount  of  information  transmitter  over  tlu-  communication 
channel  in  transmission  af  message  ami  reception  of  signal  r. ^  defined 

as  the  difference  I'rtwccr.  the  amount  of  information  included  in  message  x 


and  the  amount  of  information  which  remained  unt ransmi t ted  arter  reeepi i on 


ol  s  i  cna  1  : 

n 


i..<  '«  rj/'(  '  ft >'  '  r  I/'.  1  Up 


h  wd  ;  i”" / c <•'(, j ■  „t  !••:.; 


!  1  .  v-»' 


The  ave’Mce  amount  of  information  per  clement  are  mess, ire  transmitted 

in  a  noise  channel  can  he  defined  a5  t he  mathematical  expectation  of 

i  (  x,  z  M  ,  i.e.,  the  result  of  avera>.im*  i  f  x.  r '  1  for  all  messages  x.  , 
i.  n  v  n  1 

source  st  ;ites  ^  >  md  ;j reals  received  r  *  : 


■'  VVV, 

/  *  " 


(  1  .  s  1  > 


where  I  is  a°  fnimeriv  'he  pr  '*':i  *>  i  1  i  '  y  of  source  ;!at< 


■mi 


1 1  i  ’  ’  r 


:s  the  icint  ov.>'-  iH  1  1 1  v  of  :  rarcur.  i  s  s  i  or  of  s  j  r.n  x^  ami  reception  of  si  mm 


-  i 

'*P  ' 


ixpfssion  ,  !.’!  can  considered  as  an  lmount  ot  i  n  forma  t  :  on  a'-out 

message  x  contained  in  sjmia!  received  or.  i  n  ,i  '-ore  reneral  sepsp, 
as  an  amount  of  i  r.  format  i  m  contained  in  ;ou nonce  r. 1  wire  respect  to  sp  - 
.jiience  x. 


amount  <>f  inforrition  can  h  represented  in  ,mo,,'cr  form: 


m »v\- -'•ji't/m i 

/  t 

m.1’,/’. i’t  i' ^ 


1 1 . 


</  *  n 


where 


~  ~  —  ^  !•  M,|  ' ,)  //i«) 

<V  * 


1  \  i  1 


7/  t  %l  ■-  m  -W.  : 

7  n  k 


(  I  . ee  1 


N  X  X  >\/\;  t  •  ■  ‘/hi  '»!•■'«)  i<«  p,  (a,|.-V) 


7  n  > 


-  /O  - 


is  called  rlu“  conditional  entropy  of  message  x  in  reception  of  <ii;nal  :• ' 
(or,  in  the  more  general  form,  the  conditional  entropv  of  •••emienee  x  wit1, 
the  known  sei|uence  z').  It  is  also  called  the  "nn  re  1  i  a1'  i  1  i  t  v"  since  it 
characterizes  rite  less  of  information  durini’  transmission.  In  expression 

(i.r>) 


is  the  probability  of  the  sj^na!  received  '  i  •<  -t  . 

n  a 

It  can  easil\'  he  seer  that  in  a  channel  without  interference  !  I  ( x  r* 

since  p  (x,  'z'l  can  have  values  of  it  or  1,  as  i  result  of  whic1’  all  terrr- 
q  k  n ' 

(1.3a)  become  zero.  Therefore,  as  mii'.ht  be  exnecte.i,  in  such  a  channel  t ’■ 
amount  of  information  transmitted  is  equal  to  the  entropy  of  the  source. 

It  can  he  shown  [3]  that  always  I ! (x  z 1  ’!  •  and,  consequent  1  v 

/(A,  .•’)•//(').  1  1  •  ! 

in  which  the  equality  holds,  for  example,  in  the  absence  of  interference  i 
the  channel.  Specifically,  if  wet  z'  s  x,  then 

/iv.  A»  a  to  '■  i .  ;■ "  ■ 

The  amount  of  information  transmitted  can  be  expressed  otherwise  by 
using  the  identity 

f>,(  /»;(  Vi.)  V),l  /’, -I  ■•’,,)  /»..  (  U'.-'J 

After  multiplying  the  numberntor  and  the  denominator  o'  the  lorarithr 

in  (1.31)  bv  p  fz'l,  we  find 
'  •  q  n 
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The  expression  obtained  is  symmetrical  with  respect  to  \  and  z ' ,  as 
a  result  of  which  we  riav  concludi'  that 

/(v,  z')  /(c'.  a).  i  i  .  3 ~ 


Therefore,  from  (1.341  it  follows  that 
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If  we  define  the  joint  entropy  of  x  and  z’  in  the  followini'  wav 
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it  can  be  shown 
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Until  now  wo  have  considered  that  the  signal  received  has  onlv  a  dis¬ 
crete  series  of  values.  We  will  now  consider  a  more  practical  case  when 
z '  f 1 1  takes  a  continuous  series  of  values  characterized  by  a  probabilitv 
density  .  fr. '  1  and  the  conditional  probabilitv  dens  i  tv 

known  transmitted  menace.  After  setting  approximate  I  v  p  ( z ' )  - 

q  n 

=  .  f  z  ' ) z  '  ,  n  (  y ,  ,  z '  A  -  p  (x.i.  (z '  x.  A  *  z '  etc.,  and  then  performing 
q  n  ’  1  q v  k  n  1  q  k  q  k 

the  limiting  transition  ,\z  •  0,  we  obtain  from  fl.AM  the  following  in¬ 
tegral  expression 
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wh.ere  integration  is  performed  for  the  entire  set  ~ 1  .  ‘I'huc,  we  have  ob¬ 
tained  an  expression  for  the  amount  of  information  contained  in  a  continuous 
signal  z 1  about  a  discrete  message  x. 


\1  though  we  consider  sources  of  discrete  messages  oniv,  in  some  eases 
we  will  need  an  expression  for  the  amount  of  information  contained  in  one 
continuous  process  z’itl  with  respect  to  another  continuous  nrocess  x(tl. 
for  this  purpose  we  will  assume  that  x  is  continuous  as  is  z'  and,  per¬ 
forming  the  limiting  transition  in  (  I  . 3M  ,  we  find 
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where  .  .  ("x'l  and  .  (  x ,  z  '  ^  are  the  probabilitv  densities  respect  i  ve  1  v  of  x 

0  ( t 


and  the  ini n t  process  (x,z'l  with  source  state  s 


.Specifically,  i  f  the  source  has  one  single  state,  then 
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If  the  average  time  tal  a  to  select  one  elementarv  message  is  equal  o 
T,  the  amount  of  information  •ransmittod  in  a  communication  channel  in  a 
unit  of  time,  or  the  rate  of  transmission  of  information  over  the  communi¬ 
cation  line  is 


■  as  - 
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where  II' (x)  =  1/T  !!lx)  is  the  productivity  C  the  source  r  *  h  •  ••  • 

Jev  i  ee  and  II'  {x  z '  1  =  1  T  111  x  : '  I  i  s  the  umv  1  i  a*  i  '  :  t  ■  :  r  n  •  *  •  . 

1.8.  Carry inq  Capacity  of  a  Channel 

Let  there  be  given  a  certain  comm  in  i  cat  !  on  c1-  mr.e  I  ,  .  ,  : .  •  r  •' . . 

be  defined  a  set  of  signal?  ■  ;  ( 1 1  •  which  can  1  e  deliverr.'  *  t'a . ut 

a  channel,  a  set  ::'(t1'  of  signal*  at  the  m  1  a  •  1  *  i  y  i 

tribution  of  probabilities  t  r '  :'i  of  signals  i*  cvr  •' 

signal  at  the  input. 

If  so  >e  a  priori  distribution  et'  probah  i  1  i  ’  i  >  '•  r  ••  i  •  ,:ni]--,  •  a 

example  with  a  density  of  ^(nl,  is  giver,  it  • •'.-><  <:i.|,.  ♦,  ••  *  ’■ . 

rate  of  transmission  of  information  in  i.  co-air  i  c  c  i  on  , 

according  to  (1.4a)  and  (1.441,  is  enua!  t o 
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Here  T  is  the  average  durat  :  n  of  a  signal  w:  1  '•  , 

generally  speaking,  on  .  (tl,  and  the  densities  t  r  ’  i-d  • ,  • '  i  !uv 

in  this  expression  can  be  determined  from  t'p  ci  )•••  ,n  r  ••  e? : 
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The  value  obtained  for  the  rate  of  transmission  i;  i  n  ‘  ut.h  ,  ■  a  dene” 
on  an  arbitrarilv  selected  distribution  of  -no!  d  :  Ir  ;r.  i*  ;  ,u  .]  . 

The  maximal  rate  ol  transmission  ->f  informat.cn  w  i  *  '•  ill  re!  .d-lr  .’  s*n- 
bution  of  probabilities  of  input  signals  (  x r ,  more  evi.  *  N  ,  >.>.;*  -y  , 
limit  of  rate  of  transmission  of  :  n  forma  t  i  on''  f  is  -iilo  •  a  irrvcr 
capacity  of  the  channel: 

C  mi|. /•(■•.  C)  , 

T  I  / 1 

Sometimes  in  determination  of  a  channel  additional  !  , *  it i  •:>  ire 
posed  on  possible  probability  distributions  of  input  signals,  !  or  (■>  ir 
it  is  possible  to  require  that  the  average  s-re>,.*h  of  the  s  j  ,•••>  i  ]  not 

•Both  these  sets  may  be  discrete  as  we  I i  as  continuous.  Below,  in  crier 
to  avoid  repetition,  all  formulas  are  written  for  continuous  sets  o*‘  s;gr.i!-. 
In  the  case  of  discrete  sets,  it  is  necessary  to  replace  1  i s t r : ’ ut i on  'o- 
sities  with  probabilities  and  to  replace  in’ecration  wit*'  sunmatien. 
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magnitude  ot'  average  risk  as  is  desired  with  any  statistical  criterion  In' 
losing  a  great  deal  of  signal  strength  nr,  under  certain  conditions,  In¬ 
ns  ini;  complex  encoding  and  decoding  devices,  the  use  of  which  leads  to  a 
great  delay  between  the  instant  of  emission  of  a  message  In-  the  source  and 
the  instant  of  decoding.  Ilequ  i  roment  s  of  practice  impose  certain  limita¬ 
tions  on  signal  strength,  the  width  of  the  spectrum,  the  degree  of  com¬ 
plexity  of  equipment,  the  magnitude  of  allowable  delay  for  the  communica¬ 
tion,  etc.  If  these  limitations  are  formulated,  the  problem  of  optima! 
selection  of  a  set  of  signals  can  in  principle  be  solved. 

\  combination  of  the  two  problems  indicated  above  car  •’e  viewed  as 
the  general  problem  in  ■•ommun i cat i on  theory  and  amounts  to  the  selection 
of  an  optimal  communication  system  for  a  given  message  source,  ensuring  with 
certain  limiting  conditions  a  minimum  of  average  risk,  One  possible 
approach  to  the  solution  of  such  a  problem  widely  used  in  subsequent  chap¬ 
ters  amounts  to  the  following,  '-'or  given  characteristics  of  a  channel  and 
for  signals  satisfying  the  limitations  imposed  but  stated  in  verv  general 
form,  an  optimal  decision  system  is  determined  and  an  average  risi  computed. 
The  magnitude  of  this  average  risk  depends  on  the  set  of  signals  used  and 
on  the  method  of  transformation  of  the  message  into  a  signal.  In  mam- 
cases  it  is  possible  to  determine  such  a  set  of  signals  for  class  of  such 
sets!  and  also  such  a  method  of  conversion  of  a  message  into  a  signal  that 
the  indicated  average  risk  is  minimal  and  this  amounts  to  a  solution  of 
the  problem  posed. 

The  problem  of  determining  the  optimal  method  of  converting  the  message 
into  a  signal  is  greatly  simplified  when  this  conversion  is  broken  down 
into  two  operations,  i.e.,  into  coding  and  modulation  as  was  indicated  in 
l-;ection  l.d.  This  makes  it  possible  to  make  an  optimal  selection  of  a  set 
of  signals  based  on  the  characteristics  of  the  channel  and  the  limiting 
conditions  imposed  on  the  signal  without  considering  the  peculiarities  of 
the  source.  Then  a  search  is  made  for  an  optimal  method  of  coding  which 
converts  a  message  into  a  sequence  of'  code  symbols  unambiguously  linked 
to  the  selected  signals  and  which  allows  for  not  only  the  charactei i st i cs 
of  the  channel  hut  also  the  statistical  properties  of  the  source.  It  would 
V  ir.ethodo log i cc.  1 1  v  more  convenient  to  first  consider  the  second  aspect  of 
the  problem,  i.e.,  coding  (''banter  1!  is  devoted  for  the  most  mart  to  this 
aspect )  . 

It  should  he  noted  that,  as  a  consequence  of  the  multiplicity  of 
limiting  conditions  dictated  by  practice  and  also  as  a  consequence  of  the 
various  characteristics  of  channels  and  various  statistical  criteria  suit¬ 
able  for  various  concrete  cases,  there  is  no  general  solution  to  the 
problem  pose.,  lor  individual  and  more  typical  cases  this  task  will  be 
solved  in  subsequent  chanters.  However,  the  y  far  from  exhaust  all  con- 
lit  inns  which  are  encountered. 

\s  already  noted,  in  many  (although  not  in  all)  cases  of  practical  im¬ 
portance  in  the  transmission  of  discrete  messages,  the  criterion  of  the 
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ideal  observer  serves  as  an  adequate  statistical  criterion.  In  these,  and 
also  in  several  other  cases,  fidelity  is  the  measure  of  quality  of  com¬ 
munication  transmission.  By  fi deli  tv  we  will  understand  the  probabilitv 
of  complete  coincidence  between  the  message  received  and  that  transmitted. 
Such  complete  coincidence  fin  the  case  of  a  channel  with  interference)  is 
in  principle  possible  only  in  the  transmission  of  discrete  communications. 

With  this  definition  of  fidelity  we  must  indicate  the  length  >f  the 
message  for  which  a  probability  of  complete  coincidence  between  messages 
transmitted  and  received  is  given.  A  comparison  of  various  communication 
systems  with  respect  to  degree  of  fidelity  should  :  ’.ways  1  <-  made  using  t''o 
same  amount  of  transmitted  information. 

In  speaking  of  the  fidelity  of  transmission  of  information  it  must  be 
borne  in  mind  that  in  principle  as  indicated  in  Section  l.B,  it  is  pos¬ 
sible  to  obtain  as  high  fidelity  as  desired  if  the  speed  of  transmission 
of  the  information  is  less  than  the  carrying  capacity  of  the  channel.  In 
this  connection,  for  determining  the  potential  capabilities  of  the  communi¬ 
cation  system,  it  is  important  to  know  how  to  compute  the  carrying  capacity 
of  various  communication  channels.  This  is  also  a  very  important  problem 
in  communication  theory.  It  can  be  solved  relatively  simply  only  for 
several  mathematical  models  of  a  channel  which  usually  only  in  rough  out¬ 
line  describe  the  properties  of  actual  channels. 

It  would  probably  not  be  ami^s  to  stress  once  more  that  the  carrying 
capacity  of  a  channel  determines  only  the  potential  ca's'd  ilitv  of  informa¬ 
tion  transmission  at  a  certain  rate  (less  than  the  carrying  capacity''  with 
a  certain  given  (perhaps  very  small  but  still  differing  from  terol  proba¬ 
bility  of  error.  If  the  required  probability  increases  or  the  required, 
rate  of  transmission  of  information  approaches  the  carrying  capacity  of  the 
channel,  then,  as  follows  from  the  discussion  presented  in  Section  1  . c ,  it 
is  necessary  to  increase  the  length  of  the  sequence  of  messages  from  the 
source  compared  with  the  signal  in  coding.  When  this  is  done  the  com¬ 
plexity  of  the  encoding  and  decoding  devices  increases  very  rapidly  to  a 
limit  where  they  are  technological fv  infeasible.  In  view  of  this  it  i s 
customary  in  practice  to  be  satisfied  with  a  relativelv  low  level  of  fide¬ 
lity  or  to  transmit  messages  at  a  rate  much  less  than  the  carrving  canaeitv 
of  the  channel.  One  problem  in  communication  theory  on  which  many  have 
worked  duriffg  the  past  few  years  is  developing  methods  o*  coding  such  that 
lengthening  the  coding  sequence  of  messages  leads  to  a  relativelv  slight 
increase  in  the  complexity  of  the  system. 

All  the  problems  listed  will  be  discussed  in  some  measure  in  subse¬ 
quent  chapters. 

The  properties  of  a  channel,  spccifieallv  the  interference  and  dis¬ 
tortion  existing  in  it,  arc  considered  given.  In  engineering  practice 
problems  are  also  encountered  in  building  or  improving  existing  communica¬ 
tion  channels  and  reducing  the  relative  level  of  interference  (for  example, 
by  improving  the  design  of  the  cable  in  electric  wire  common i cat i on ,  hv 
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improving  directivity  in  receiving  antennas  in  radio  comrnun i cat  i on ,  and 
many  oflier  methods  ur  to  :md  including  creation  of  ;i rt  i  fi c i ;i  1  ioni  r.it  ion 
in  the  upper  layers  of  the  atmosphere).  ‘uich  problems  go  bevond  the  frame¬ 
work  of  general  communicat  ion  tlieorv  and  wilt  not  he  considered  here. 

Notes 

1.  (^ee  Sections  1  and  .’)  In  most  works  on  common  i  cat  i  on  theory  , 
mutually  unambiguous  correspondence  between  message  and  transmitted  signal 
is  assumed.  However,  in  actual  communication  systems  this  is  far  from 
ilw.nvs  so.  Verv  often  a  particular  message  ma\  bo  converted  into  different 
signals,  for  example,  two  signals  differing  only  in  cot’p. (ant  coefficient 
in  many  communicat ion  systems  correspond  to  one  message.  With  a  shift  of 
t  lie  signal  in  time  *'v  a  cor*  a  in  magnitude,  usual  lv  a  signal  is  obtained 
which  corresponds  to  that  message.  With  narrow-hand  signals  a  change  in 
phase  of  the  h  i  gh- frequency  filling  and  even  a  change  within  narrow  limits 
in  its  average  frequency  in  mane  cases  likewise  loos  not  change  the  message 
to  which  the  signal  corresponds. 

Because  of  this  the  transmitted  signal  amounts  to  an  element  ot  not 
i  discrete  but  a  continuous  set  of  possible  signals. 

Many  authors  cempletelv  ig.nore  this  fact  and  i*  y>meti”vs  leads  t. 
important  divergences  be'wcen  theoretical  remits  and  pr.actice.  <Hhor 
authors  (.for  example,  leip.srein'  view  the  am!'i>,ui,\  in  a  sirr.a!  as  a  re¬ 
sult  of  the  effec’s  e1'  "  i  rt  erfr  rep.ee"  occurring  at  'hr  ins- ant  of  signal 
trar.sm'  ss  i  on . 

f.  I'-eo  feet  ion  I  . -I  1  'he  •  -n  *  ropy  of  a  source  of  information  is  de¬ 
termined  Hy  euua-'i.ns  (  1  .  “1  and  i  1  .  I  '*  d  is  the  mathematical  expectation  of 

an  amount  of  information  per  eic"'ent  o‘‘  a  message,  -•'o  that  t h  i  s  'magnitude 
have  the  actual  no  .an  i-g  if  the  average  'value  of  tue  amount  e‘*  information 
per  element  in  a  certain,  sufficientlv  long  seuuenee  of  message  elements, 
it  is  essentia!  that  the  source  satisfy  certain  conditions  ot‘  orgoficitv 

[  1 1  .  f'rrictly  speaking,  actual  sources  o*‘  •  n  format  i  or,  are  nor  errodtc 

but  can  be  considered  approx i rri te  1  v  so  if  the'  are  considered  over  a  stretch 
of  not  very  long  segments  of  rime. 

The  concept  of  entropy  of  a  message  source  is  closely  related  to  the 
thermodynamic  entropv  of  a  physical  system  which  forms,  together  with  the 
observer,  a  source  of  messag.es.  The  greater  the  thermodvnami  c  entropy 
(depending,  spec i f i ca 1 lv ,  on  the  number  of  degrees  of  freedom)  the  greater 
(lie  amount  ot  information  reunited  to  describe  its  state.  Frillouin  M"1 
made  a  detailed  investigation  of  the  relationship  between  i n format i ona 1  and 
thermodynamic  entropv. 

a.  (See  Section  ].(■>)  The  IWaves  criteria  which  are  based  on  minimizing 
average  risk  f 1 . f 1 )  are  suitable  for  designing  a  decision  system  onlv  in 

those  cases  when  the  a  priori  probability  of  elementary  messages  pfx.)  are 

i 

known.  In  some  cases  in  designing  a  communication  system  (specifically  if 
it  is  intended  for  connection  to  several  sources  previously  unknown''  the  a 


-4J- 


priori  probab  i  i  i  t  i  os  cannot  be  determined.  In  uch  a  ease  the  pm  Mi  rax 
criterion  is  often  used  as  a  basis  for  desiiMiinr  'be  decisi-T  < <  t  - -in . 


The  minimax  criterion  is  a  method  for  <  va  lua!  i  nr.  a  decision  sv.'er 
in  which  maximal  values  of  conditional  ris!  (l..’n‘i  are  compared  and  Me- 


maximum  is  taken  for  messages  x.  for  each  decision  system. 

1 


max 


V  i, 


j)  /■ ;  j  > . ) 


in 


\  decision  pattern  which  provides  for  i  ni'nr.il  cii 


far  which  the  maximal  l Tor  ill  messar<'s  -  nlitiona!  r  ! 
least  not  creator,  than  for  any  other  Vui*  :•  a:  yy«*  <>r  ;« 


It  can  be  shown  I  lt.?t  that  t  hi  minimi  x  criterion  It  ads  •  he  cn:'" 
decision  system  as  does  the  Hayes  criterion  o'  minimai  iverai"'  r  i  s !  wit1' 
t  lie  condition  that  the  a  priori  distribution  of  probabilities  <•''  mess., res 
is  selected  so  as  to  be  the  least  favorable.  If  in  actual!' v  ♦  »>e  a  "  r  i  <  ■  r : 
distribution  of  probabilities  i  c  not  the  least  fav- -rd'l  .  f'en.  1  j  *; 
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If  in  (1.211  we  set  the  cost  ntx-.x!'  with  x i  xL  o''  the  inversely 

till 

proportional  a  priori  probability  n(x.'  ion  the  basis  'Lit  tin  in ‘or  mat  j  aial 
content  of  the  message  increases  with  a  decrease  in  the  i  priori  p*  obal- ':  1  i  t  yt 
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then  it  can  easily  He  soon  that  the  criterion  of  minimal  average  risl  co¬ 
incides  with  the  criterion  of  maximal  1  i  1-  e  1  i  linml . 

Several  authors  To,  1-1]  snidest  that  the  informational  criterion 
that  according  to  which  the  optimal  decision  system  selects  that  one  of 
hypotheses  x.  in  which  the  particular  amount  of  information  contained  in 

an  arriving  signal  r. '  with  respect  to  messace  x  ,  eipia!  to  1  og  ( ..  ( 1  1  Xj  1  /  .  f  c  ' 1  1 

is  maximized.  This  approach  also  leads  to  the  criterion  of  maximal  life 
1 i hood . 


•1.  (See  'section  1.")  Ixprossjon  f  1.4x1  for  the  amount  o*‘  informa*'ion 
contained  in  one  continuous  process  r '  with  respect  to  anoftu'r  continuous 
process  can  he  changed  as  t'o lions; 


w  l-  (f| 

/(x.  -*p  1 1  l-(x.  .•') i tt  •/* 


(f' 

xzf 

f  j"  ®(x,  .•')  !i>g  [_  *  */x  /-•' 


w  (x) 


-f 


cr  (x)  lllg  IT  (i )  f\  I 


T  /' 


+  cr  ( •')  tf  f  xj  •  'l  lug  p  (%  '  ■')  lx, I h  t(x)  -  -  Aft1.-') 


I  1  .  "'Vi 


.X.” 


shannon  calls  the  magnitude  h  ‘  x  ^  -  f  «•  (x)  log  cr  {,  irfx  k.  t'-o  ertropv  of 

X 

continuous  process  and  the  marnitude  h  (<'-U  -  f^;r(--)x  ir(t|/')io  g  1. t/ 

re 

the  conditional  entropy  of  a  process  x  with  a  1  noun  orecess  I'owever , 

such  terminology  is  not  especially  fortunate  since  the  indicated  magnitudes 
do  not  possess  those  properties  w'  icii  are  had  hv  en trope  and  the  conditional 
entropy  *  f  discrete  sequences  Ilfxi  and  H  ('  x  r '  1  .  'lheroforo,  following  \. 
Kolmogorov  fp],  we  will  call  hlxl  and  !i  i  x  r 1  1  the  dir*erential  entropv  and 
the  differentia!  conditional  entropv  respect  i ve 1 v . 

\s  was  shown  in  i;ecticn  l.~  the  entropv  of  a  liserete  res  sago  !  ’  x  >  \ar 
he  define*!  as  rne  mount  of  information  included  in  x  with  respect  to  it¬ 
self,  II  (.  x  1  =  I  (  x  ,  xl  .  The  differential  entropv  does  not  have  this  reaping. 
Indeed,  from  (1.4x1  nr  from  (  1  .  '  it  can  he  shown  in-  means  of  massage  to 
a  limit  that,  for  a  continuous  process,  Ifx.xl  -  ■. 

This  is  altogether  natural  since  for  an  exact  description  of  a  finite 
segment  of  a  continuous  process  its  value  must  he  regarded  at  an  infinite 
number  of  points.  I ven  for  an  exact  setting  of  the  'ahie  of  a  continuous 
random  variable  describing  the  distribution  densitv  .  (xl,  am*  fini'o  •~ar- 
nitude  assigned  to  the  amount  of  information  proves  tr  be  i nsuf f  i  c  i  ent  . 
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I'll  is  can  ho  expl.ai  ncd  as  follows.  Ho  will  hreal  the  ontiro  ilonain  of 
values  of  the  variable  x  into  sopmonts  of'  sire  '\  am!  we  will  produce  f'>is 
magnitude  with  a  precision  of  'x'd.  Obvious lv,  the  amount  m'  i  n format  i  on 
needed  for  this  can  he  defined  as  the  enfropv  of  a  discrete  mum  i  t  tide , 
adopting  the  values  of  x.  with  a  prohab i 1 i tv  of  w(x.i  x: 

n. { ti  Vsii.ui  i  k 1*1  .  V - 1 < ,i  •.>  i m.i - 

tJ  w 

—  V  !/•  ( i , )  i  i  l'  i;  A  >  •  V]  -  l  ■  i  >  1  •  1  K  -  <  ‘  *  ;  1  i ,  • 


If  now  '.x  is  allowed  to  approach  rero,  i.e.,  the  ot  ecision  with,  wh-i’ 
the  continuous  random  variable  is  set  increases  without  1  i  r  i  t  ,  the 

term  in  (l.all  approaches  the  differential  ent  rop\  *  ( > )  J  ai'  )  l  -j  i  <  i 

I 

and  the  second  t<  rm  increases  without  liri*. 

1’his  result  can  on!'.  Ke  e/plrlned  in  the  followin'  ua\  .  :'•••!•<’  i -• 

a  channel  with  complete  absence  of  noise  so  that  the  signal  ••••coivod,  r'ft  , 
is  identicallv  emial  to  the  transmitted  continuous  sjj-nal  r  *'  for  in\ 

\  line  of  is  a  repul  nr  inverse  function  of  r  ,  then  1  f  r ,  r '  '  •  and  it 

should  he  possible  to  transmit  over  such  i  channel  m  error-''roe  messai'e 
from  any  source,  no  matter  what  the  product i v t v .  !f  t  *’  o  dependence 
between  x  and  is  not  repular  but  inverse,  then  lir,-1'  is  a  finite 
pi  s i t i ve  magnitude.  He  will  point  out  apain  that  the  term  "corf i nu  uts 
sipna!"  is  to  he  understood  not  in  the  sense  <*'  cent i nuousness  -f  the  func¬ 
tion  ;  ( 1 1  hut  in  the  sense  th  it  the  sipna  Is  -  <  t 't  ap'  element*  of  a  continuous 
sot  . 

The  differential  enfropv  h  x '  ,  in  contrast  to  the  •ntro',v  a  d:  - 
crete  source  Hfxl,  mnv  assume  nerative  values.  '  urthermoro ,  t  •  dirierep- 
t  i -i  1  entropy  r  iv  at  will  chance  its  ’.-alum  and  even  its  sipr.  w 5 ' u  i  c'-anpe 
in  the  unit  of  measurement  of  inaptitude  x  since  when  this  occurs  the 
value  of  .  t  x")  changes.  As  far  is  the  difference  in  >1  i  f ‘‘eren*  i  a  1  entro-". 

(l.?d)  which  is  equal  to  the  amount  of  information  contained  in  one  con¬ 
tinuous  process  with  respect  to  another,  it  does  not  depend  on  the  unit 
measurement  hut  on  the  logarithm  hasp  (i.e.,  on  »he  selected  unit  for 
amount  of  information-).  In  aetualitv  wi'h  continuous  processes  m  1  v  t*'o 
amount  of  information  has  a  phvsical  noaninp,  i.e.,  the  difference'  of  dif¬ 
ferential  entropies  and  not  the  differential  entropv  itself. 

We  will  point  out  that  hv  sinnLe  rransformat  i  or  it  is  rossr  le  :  .•> 
exnresn  I(x,;'A  hv  ar  a  lofty  with  f  1  . 4 n 1  follows: 
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|  ( 1 1*1*  .nnl  ndul  .tor  js  ji :  ven .  ’  n  those  oases  the*  channel  is  that  part 

:  ...  'r.r.ur  ir  i  ■  :  .'it  line  wl'.  i .  •  •  •  is  i  n  '  i  rr  i  ed  i  •'  1  i  pure*  l.~  'n-  the  hrol  en 
•  ’•!  -  !o  i  v  a  r  ■  ’•*  1  i  vored  t  o  the  input  of  such  a 

■  i  ;  i-.i  i'ivr.  the  •  m  :  *  ae  *  dm  svm.hols  v*  w1'  i  eh ,  pencrnllv  seen!  inp, 
!  a  n,M  .  i  r  .an  v  :  •  ■  (  r  i  p! !  r-c  d .  !  . 


mi,"  a  v.  autre.  is  Mile-. I  discrete.  In  studvim’  t  ransm  i  «s  i  on  of 
ross-ujos  a  (i  i  sere'  • 1  ,<  rain  »roi-  lem  is  rn  find  methods  of 

cne.nl’ 0).'  uni  decod  imp  wh.  i  eh  permit,  in  one  sense  or  another,  r  ransrci  t't  i  np 
.  atv  cf  a  •  1  •  s  ••  *  t>  source  . 


...  v.  1!  rate  that  :•  il'nosr  ail  actual  oomnun  i  eat  j  on  lines  a  discrete 

,  "I’ni'i  cn,:  i  rs  t,  i  tit  in  itself  i  eon  ri  minus  channel  at  t  he  inmit  of  which 

. '  •.  1  i  •  a  del  1  •.•••red  and  '«■*  t*’e  output  of  which  signals  r'^t’i,  dis- 

t  •  • . ;  '\  ”  :  c  r  (crer.ee  ,  ir>*  tnlen.  !he  ’•  roper*  i  es  of  this  continuous 

r  .at--;,  ■...  i  ♦ 1 ,  the  ;!i  ir.:C.  eri  -•  ,-s  a*"  the  modulator  ;  mi  demodulator, 

’  ••  dp*  or'  ne  ii!  •  t  o*‘  the  diserete  channel.  therefore, 

■.*.  ..  i :  ■•••am!  ;■  '.It'd  a  discrete  representation  of  a  con- 

■  ,-  11  i  r.  r  it  hor.af  i  ea  1  i  pares  t  i  pat  i  on  o<‘  a  discrete 

a  :  ••  •  •  ••  -  •  n  -  :  •  ;  .  h.  iiriei  and  the  interference  act  :  m*  on  it  are  ne- 

>■•  ;  .  -  *  t»*  ■  mid  •  ,  'i  sc  rete  c'earnel  ,  pi  i  n  p  an  alphabet 

a  --a.  ...  ; . -  rrr.a'i'  ;t  i  *  s  input,  an  aiphalet  of  code 

;  '  *  . . .  ;  •  etna  ,  the  nupi’ev  ’•  af  -ode  svmUn  1  s 

■  :  ,  *  ,  , ; ;  !  :  »|.  ac  •  1  • !  •*  ••ro’-a''  i  !  i  t  i  es  r  f  conversions 

,  • 1  ■  ■  •  a  -a-'ho:  v '  appears  at  the  outpu* 

1  •  • ,  :  emit  .  ''h’sr  proh.al’i  1 ;  t  i  es  tiepeml  on 

.  :  ,  vrr  *  were  '  ransm:  ‘  *  ed  e:d  receaed  rre-.i  ous  1  v .  ''lie  alphabet  of 

.  ,h  a  -he  iirn'i'  md  e'ma  *  •'  i  c'.ipnel  r.eed  not  i.e  the  same,  sp.e- 
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other  names  are  usetl:  a  channel  without  memorv  or  a  channel  with  inde¬ 
pendent  errors.  II',  however,  the  conversion  probabilities  depend  on  time 
or  on  conversions  which  have  talen  place  nreviouslv,  the  channel  is  called 
nonuni  form  or  a  channel  with  memorv. 


I  n  t  er  Terence 


Fiqure  ?.).  Communication  System  with  a 
D i sc  re  te  Channe 1 . 


In  a  channel  with  memorv  the  nrobabilitv  ties,  at  least  in  the  first 

approximation,  are  distributed  only  over  a  certain  finite  segment.  This 

means  that  the  conversion  probabilities  p(v|  v.d  depend  m  what  conversions 

•  •  .1  : 

took  place  in  the  transmission  of  the  preceding  1  svmhols  and  do  not  depend 
on  earlier  conversions.  Such  ,a  channel  is  said  to  have  a  series  of  dis¬ 
crete  states  S . S  which  are  determined  hv  preceding  conversions,  the 

!  1  |. 

re  1  a  t  ionsh,  i  ps  r  *"  f  mm ' )  '  holding.  For  each  state  s  conditional  conver¬ 
sion  probabilities  p  (v!  v.)  are  defined.  ^t  the  same  tire,  on'.v  the  last 

1  (j  i  •  ! 

1  svmhols  transmitted  and  received  determine  the  channel  states  s*  _ 

a 

The  iverage  unconditional  conversion  probabilities  are  detcTMied  in* 
averaging  the  conditional  probabilities  oyer  all  the  'hannel  states 

r 

p(»'s\»,)  V  Vj’Jn' ,[!,).  i.'.!' 

where  I’  is  the  probability  of  state  h  , 

(j  '  u 

in  actual  channels  in  rleront-hv-e'cmonf  recepr  i  on.  the  conversion  pro 
'•abilities  ptv!  v.'i  are  not  given,  'mt  are  determined,  op  the  one  ’-ntd,  hv 

■  •  t  i 

interference  and  signal  distortion  in  the  channel  and,  on  the  other,  the 
transmission  rate  v  of  the  code  svmhols  and  '\v  the  first  decision  svstem. 

By  selecting,  on  the  basis  of  one  criterion  or  another,  the  optimal  de¬ 
cision  •  system ,  it  is  possible  to  change  the  conversion  pro'',-!1'  i  1  i  t  v  in  the 
desired  direction.  In  order  to  consider  a  channel  discrete,  it  is  neces¬ 
sary  to  select  the  first  decision  svstem  and,  taMm?  into  account  the 
•  'Tective  interference  and  distortion  in  the  channel,  to  compute  the  cep  - 
•ersion  probabilities,  nhviouslv,  in  those  cases  when  the  parameters  of 
an  actual  channel  are  constant  and  the  active  interference  in  the  channel 
is  a  stationary  random  process,  its  discrete  represent  at i on  is  a  constant 
channel.  If  these  conditions  are  not  met  the  discrete  representation,  as 
<i  ruie.  is  a  channel  with  memorv. 


Figure  2.7  Probabilities  of  fonver-  rinure  ? .  1 .  proh,ih '  l  I  \  m-*-  >f  r 

sion  in  a  Symmetrica!  Rimr\  fbannel.  version  in  ,i  |i  r 

fhanno I . 

If  the  alphabets  at  the  'limit  am!  output  of  a  unitor:"  c'"  •  r ■  ?• !  are 
identical  and  for  any  pair  i  i  i  the  prol'a1'  i  1  i  t  i  os  me!  .  1  -  cons*, 

then  this  channel  is  called  symmetrical.  He  will  also  cal!  a  ■  a:’  d-le 
channel  symmetrical  if  in  every  state  s  for  anv  pair  i  *  ;  i s  fulfilled 
the  condition 

P^(u'Jlh)  Pi  const (i.  /). 

from  (2.21  it  obviously  also  follows  that 

p(i/,ly, )  co»st.  1  \v> 

hut  it  would  not  he  true  to  assert  the  converse.  Channels  wi*‘  ’•emore  in 
which  (2,."1  is  fulfilled,  but  f'2.21  is  not,  or  not  for  all  u,  v  ;  1  1  be  called 
average  symmetrical  channels,  figure  2.2  sohemat i ca 1 1 v  shows  the  conversion 
probabilities  in  a  symmetrical  channel. 

Among  the  channels  in  which  t!-e  alphabets  at  input  and  output  are  net 
identical,  the  so-called  erasure  channel,  m  which  m'  -  •"  *  1,  is  of  in¬ 
terest.  It  gets  its  name  from  the  fact  that  its  output  alphabet  emtains 

the  additional  svmhol  v'  ,  signifying  ’’erasure"  besides  t  hi  symbol*.  y  ...y 

•  m+  1  1 

common  to  both  the  input  ami  the  output  alphabets.  'he  e'poiraruo  ot" 

v 1  ,  means  that  the  transmitted  symbol  Vis  been  distorted  *u-  interference 
■  m+  1 

and  cannot  he  recognized.  Therefore,  a  portion  of  the  received  code  s,..iuenc 
has  been  erased. 

As  will  he  shown  subsequently,  introduction  of  this  erasure  s\mbo] 
does  not  disturb  the  feasibility  of  correct  1>  decodin'  rf(-  received  cede  se¬ 
quence,  hut,  on  the  contrary,  facilitates  it  when  the  cod;ng  methwi  an1  de¬ 
cision  systems  have  been  rationally  selected. 

Let  us  observe  that  the  code  alphabet  at  the  output  is  determined  *n- 
the  choice  of  the  first  decision  system  and  is  there!  ire  considered  to  he 
given  only  because  we  are  examining  the  discrete  representation  of  the 
channel.  The  choice  of  the  first  decision  system  also  to  a  considerable 
degree  determines  the  characteristics  of  channel  symmetry,  figure  2.3  shows 
the  conversion  probabilities  in  a  symmetrical  erasure  channel. 
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to  be  a  two-digit  decin.nl  nitn,'er,  i.e.,  we  ••  •  !  1  '  .'er* 


a  r 


-  1  no  mid  will,  as  before,  reduce  c'dine  *o  reoresp 
in  the  binary  svsteir.  I’ven  m inker  !•■<«  ♦»  m  !■"•  :•  ,r 

•  >  C  1  . 


■r- 

• ;  mi 


seven-digit  Mn.arv  mirber  (bee  mse  d  -  id-  1  !  re 

six-digit  bjnarv  lumbers  do  no*  sufiee  t.  rr'f 
numbers'!.  In  this  coding  eu'rv  two  mess./e 
svr.bol  s ,  i.e.,  an  .average  of  % .  *  -ode  s-. Is 
a  1 nhabet  en 1 arpement . 


Let  us  continue  enlarging  *ke  aloha'-et  ».v 
lifted  bv  the  source  as  a  three- digi*  dm  1 1  am 


1  , 


in  the  'unary  system  bv  a  !  • '  -  d  i  g ;  *  rvir,'er  in 
sequent  lv  in  this  coding  one  dtei*  rent:  i  *••••■  i;1 
is  alreaiiv  verv  close  to  the  f  '’.core* : c  1 1  Vt  \  . 


burthen  enlargement  >•*  t'-e  a  1  nhabet  :  1 


digit  transmission  rate  over  *-;-:s  K :  r:  •  rv 


inro 


•ven  '1 


v.  log,  I",  but,  of  course,  net  to  go  ■  m  o-  '  i  *  .  >• 

emitted  bv  the  source  are  combined  into  m  \ -digi* 


be  expressed  bv  a  v-digit  bin.arv  lumber  cuiiitio- 
x  log ,10  ■  ,  whence 

r  t 

2  u  'i'g.bb 


\.  V.  Kolmogorov  first  point  out  th.s  -  —  lr  ’  •<: 


In  tin'  i’  iven  l'  :  i  s  e  the  equal  s  i  s>n  is  even  impossible  si  run'  with  \',i  i  ’  1  < '  - 
number  values  of  x  and  ■  the  eqna !  i  t  v  x  Ion  JO  -  v  moans  that  I  o»’  ^ ! (1  is  a 

rational  number,  while  in  roalitv  it  is  irrational. 

In  general,  when  II  -  II  ,  hut  ’  is  not  a  whole  ,  r  rational  power  of 
*  max 

in,  there  max-  he  found  for  anv  number  b  a  whole  number  a  which  males  these 
i  iH'iiua  1  i  t  i  es  t  rue : 

v;.:  "■ 

We  will  retard  everv  b  message  letters  as  a  letter-  of  an  enlarred  al¬ 
phabet  containing  '  elements  and  will  establish  a  mutuallv  uniuuo  eor- 
resnondence  between  the  enlarged  letters  and  the  code  combinations  of  a 
uniform  a-digit  code,  as  can  alwavs  fe  ilone  on  the  basis  of  (.’.If)  isince 

''  m'1')  ,  and  some  of  the  comh  i  nat  i  mm  will  also  remain  unused,  'then  ovorv 

comhination  of  a  svmhols  transmitter*  over  the  channel  corresponds  to  h 
letters  of  the  primarv  messape  alphabet.  I 'ere  the  transmission  rate  is 


Iron  ..’.lift  we  have  *>  lor 


a  lot;  m  (b 


w*'ore  -.  -  lor  r  lo,- 


expression  max-  be  w  ritt 


in  the  ‘‘orr 


here  0 


l  f.ip,  t  j  t; 


,rl  c,m  t'’  !  It.h 


lev,  /  ft  | 


ft  ~  C  ft  _  r  I' 
ii  ft  i  ft  ^  a  ft  i  i 


-■s-o 

if  number  b  is  chosen  from  condition  ^  ^  iji  ,  then 


rnd  this  is  what  we  wanted  to  prove. 


!  .’.I  -n 


!*ie  result  derived  shows  that  in  a  -har.ne!  with  carrxinr  eapacitx  r 
we  can,  'n-  us  ini:  a  uniform  code,  transmit  the  messares  of  atix-  umree 
which  has  an  alphabet  of  sice  and  can  do  so  at  a  rate  as  close  as  de¬ 
sired  to  C/ll  -  C/lojtv  letters  per  second.  i\e  will  call  this  the  primarv 
ma  x  '  - 

method  of  coding.  This  confirmation  is,  of  course,  less  rigorous  than  re¬ 
quirement  of  the  theorem  according  to  which  anv  source  with  entroov 

i‘  II  can  have  a  transmission  rate  as  close  as  desired  to  C  l!, 
max 


2.3.  Methods  of  Fliminatina  Messaae  Pedundnncv 

If  the  messrtpc  source  has  no  redundance  its  product i v i tv  is  I1’  =  H' 

pi  ax 

and,  as  was  shown  in  Section  2.2,  a  simple  procedure  can  encode  the  mess ape 
for  transmission  over  a  noiseless  channel  with  carrving  canacitv  f  •  I" 

ma  x 

In  the  case  of  a  source  with  rcdumlancv  II'  •  I!'  .  Therefore  the  problem 

ii'  Lin.  .  max 

often  arises  of  transmitting  its  message  over  a  channel  with  carrvinr  cana¬ 
citv  >'  •  I!'  which  is  in  principle  possible  provided  that  f  I!'.  The 
ma  x  ' 

appropriate  coding  must  transform  rite  message  element  smmence  with  redun- 
ilancy  into  a  code  svmhol  sequence  wit  unit  redundancy  or  with  cons  i  ilerah  1  v 
less  of  it.  Therefore  this  codipg  operation  mav  he  called  rednndancv 
e 1 i minat i on . 

Let  us  first  study  the  case  where  a  source  selects  elementarv  messages 
which  do  not  have  the  same  probabilities,  but  selects  t  icm  independents 
of  each  other.  In  this  case  the  entire  redundance  of  the  source  is  the  re¬ 
sult  of  the  unequal  probabilities  of  the  elements.  This  rednndancv  mav  be 
eliminated  completely  or  partial lv  if  durinp  encodinc  the  most  probable 
elements  are  represented  by  short  code  svmhol  sentiences  and  the  less  pro¬ 
bable  by  tony  sequences,  l-’rom  this  it  is  apparent  that  this  efficient  code 
must  be  nonuniform. 


If  message  element  x^  is  represented  bv  a  code  svmhol  sentience  con¬ 
sisting  of  n^.  symbols  the  average  number  of  symbols  n  in  the  code  spuiienoo 
ner  element  is 


h  V  /’ 


Maximum  entropv  II  fvi  of  the  code  sentience  per  svmhol  coin  1  s  lop  r, 
ma  x  ■ 

where  m  is  the  number  of  different  code  symbols,  fonseouent 1 v ,  the  avertin' 
code  sequence  entropy  per  combination  ( 'correspond i m>  to  a  nossape  element''  : 

i 

.« 1N>)  V_  /MnirJ'Mr,  (^.lM 


The  chief  requirement  made  of  anv  ctnie  i  ;  '  *'  a  t  it  be  possible  to  tin  - 
ambiguouslv  decode  the  code  sentience.  This  lends  to  rite  stipulation  that 
nil  (yd  =  ll(  x'),  whence 


II  |<> 
'll  l:U 


//  <>  t 


Ul' . 

k  I 


(2.1 


The  expression  derived  rives  an  estimate  from  below  of  the  avornio 
code  combi  pat  ion  length.  The  task  of  economical  cod  inn  is  to  select  a  code 
enabling  ns  to  move  n  as  close  as  possible  to  that  estimate.  I1’  in  expression 


(2.17)  equal i tv  is  achieved'  this  means  that  ll(v)  =  II  (v)  and  that  the 
1  •  max 

code  sequences  obtained  will  have  no  redundance,  otherwise,  residual  re¬ 
dundancy  will  remain  and  will  be 


T 


u 


II  lw) 
//  la.iX!/) 


//(O 
n  I  g  m 


(7.  1  ft ’I 


This  redundancy,  however,  may  alwavs  he  made  substant i a  1 1 v  less  than 
message  redundancy  r  =  1  -  Til  (’ x)  1 !  1  >g  ’ . 

Actually,  by  using  primary  oding  (Section  2.2)  with  .a  uniform  a-digit 
code  we  may  derive  n  as  close  as  desired  to  Ion  '/log  m,  which,  by  substi¬ 
tution  in  .(.2.18),  will  give  r  =  r  .  But  by  using  a  nonuniform  code  we  mav 

always  shorten  the  average  code  combination  length  r  by  employing  the  shorter 
combinations  for  the  more  probable  igns  ('provided  that  the  message  letters 
are  not  equi  probable)  ;  anti  we  may  thus  derive  r^  ■  r  ,  i.e.,  <  I  initiate  at 

least  some  of  the  redundancy.  I.et  us  note  that  residual  redundance  can  be 
made  as  small  as  desired  by  enlarging  the  .alphabet. 


When  designing  an  optimum  nonuniform  code  which  permits  maximum 
limitation  of  redundancy  we  must  tale  into  cons i derat i on  the  remtiremenf 
for  unambiguous  decoding.  It  is  easy  to  see  that  this  requirement  will  be 
met  if  not  one  combination  of  a  given  code  coincides  with  the  beginning  of 
another  longer  combination.  This  code  property  is  called  "i rrcducihi 1 itv." 

In  decoding  a  code  syr'* ’1  sequence  the  property  of  i  rreduc  i  M  1  i  tv  permits 
the  unambiguous  division  of  this  sequence  into  code  combinations  and  the 
comparison  of  the  corresponding  message  element  with  each  code  combination, 
i.e,,  decod i ng .  •  . 

Tor  example,  a  Mnarv  code  with  base  m  -  2  containing,  code  combinations' 
00,  01,  100,  101,  110,  and  111  is  irreducible,  whereas  a  code  containing 
the  combinations  00,  oi,  |0,  11,  non,  nni,  n]n  js  not  because  combination  nl 
coincides  with  the  beginning  of  o|p  ,unl  combination  oo,  with  t*'o  beginning 
of  combinations  ooo  and  omi  .  The  first  of  these  codes  permits  unambiguous 
decoding.  If,  for  example,  the  code  sentience 


‘It  is  easy  to  prove  that  thi;  equality  is  possible  and  alwavs  attainable 

if  each  of  the  probabilities  pCx^.)  equals  m  '  k  ,  where  n(  i «  a  whole  number. 

■The  property  of  i rreduc i b i 1 i tv  is  sufficient,  but  not  necessary,  for  unam¬ 
biguous  decoding.  !t  may,  however,  he  shown  that  the  stipulation  of  irredu- 
cihility  does  not  limit  the  degree  of  redundancy  elimination  attainable 
(Remark  2  to  Chapter  II). 

It  is  convenient  to  designate  code  symbols  by  numerals.  When  the  code  base 
is  m  we  will  designate  the  symbols  t’v  the  numerals  11 ,  1  ,  .  .  .  ,  (m- 1)  . 


-Tip- 


0(101 10 i ! i 1 0 1  lllll)|(J()ll).)l  luDilliiiil  101 


is  received,  it  may  be  divided  into  code  combinations  only  in 
k:iv  : 


'III  1  nil  I  III' 


00  01  101  01  ()|  10!  01  00  100  1  Hi  01  00  01  111! 


It’  the  second  code  without  the  nrnpertv  of  i  rroduc  ibi  1  i  t  v  wop’  em¬ 
ployed  there  are  different  wavs  in  which  the  same  sentience  could  b(.  d:vided 
into  code  sequences,  for  example, 


or 


or 


etc . 


oo  01  1()  lo  in  1 1  oi  oi  (Ki  id  oi  id  in  oo  m  in 

000  11  010  1.1  I  |  i > ! 1 1  III  Oil!  0i  |(|  oil)  001  II! 

ooo  I  I  01  010  I  1  01  (II  0O|  (I'll  III  ()|  Dll')  II  01. 


Various  methods  (a  1  gor  i  t  hmsl  are  inown  r!,a,-l]  for  const  ruct  i  nr  irre¬ 
ducible  nonuniform  codes  of  base  n  which  make  possible  rhe  greatest  decree 
of  elimination  of  message  redundancy  for  a  given  source.  U'e  wii.  describe 
the  most  genera  1 -purpose  method  which  was  proposed  by  Huffman  N.o^l. 

All  the  letters  of  the  message  a  Inhale*  i  ’  in  number-!  are  written  down 
in  order  of  diminishing  probability.  If  the  number  1  is  not  dhisi'Me  i«v 
m-1,  additional  "letters"  are  added  to  t lie  alphabet  and  arc  ascribed  a 
probability  of  cere  so  that  for  the  sire  '  '  of  the  alphabet  tl'us  obtained 
the  stipulation  of  divisibility  of  '-!  i»v  i s  fulfilled.  ’’ben  rhe 
following  m  elements  of  the  derived  alphabet  are  consolidated  inti'  an 
"enlarged"  element  and  the  nrobahi I i tv  is  computed  and  no“od  in  the  appro¬ 
priate  place  in  the  alphabet.  The  same  procedure  is  followed  with  the  last 
m  elements  of  the  derived  alphabet  ("including  the  enlarged  ones'1,  and  this 
is  continued  until  there  remains  an  "alphabet"  consisting  of  m  elements. 

The  single-digit  code  combi nat i mis  O, 1 , . . . , in-P  are  ascribed  to  those  m 
elements  in  any  order.  If  these  remaining  r  elements  include  anv  which  be¬ 
longed  to  the  original  alphabet  t’i.e.,  not  derived  by  consol  i  d.at  i  on  o*'  other 
elements’)  they  prove  to  be  encoded  one-digit  code  cnr-h  i  nat  i  ops  .  1  or  those 

elements  derived  by  consol  i dat  i ng  m  letters  of  the  original  .alphabet  into 
code  combinations  the  second  symbols  are  written  rut  so  that  thes.'  signs 
prove  to  lie  encoded  two-digit  combi nat i ons .  If  among  these  two-digit  com¬ 
binations  there  are  anv  which  correspond  to  elements  also  derived  ’\v  con¬ 
sol  illation,  then  third  symbols  are  ascribed  to  these  combinations,  and  so 
on  until  all  the  elements  of  the  original  alphabet  have  ’rim  encoded. 

As  .an  example  we  will  construct  a  nonuni  form  code  o<'  base  m  =  -1  hv 
using  code  symbols  0,1,2,  and  a  for  the  source  with  an  alphabet  consisting 
of  !(■  elements  (which  we  will  designate  with  buss  i  an  letters'!  with  the 
following  a  nr'ori  probabilities: 


r  (',i 


ii  lit 


it, m  1  | 

l-.-.l  1  K  | 
i.'-t  L  | 

n  ii.'  1  M 


I'.oi:.  IJ  N  ii.oi 

o. "I  j  u  uni 

ii, o|  1  P  iii-j 

".(•I  R  hi-  , 


I  h ■'  intropv  of  t 1 1  i  s  source  is 


II  u)  V  /•)(»,!  !--)•.  /■(<•<)  ‘J . * ^ ) 7 


bit;  nor  s  i  cn  and  its  redundance  is 


'■  1  i.,; ,  •  1  •  ",  • 

In  the  yivon  ease  ’-!  -  If.  is  divisible  bv  m-1  =  a ,  so  there  i  s  no  need 
!o  introduce  sunn  1 erenf a rv  letters  into  the  alphabet. 

I.et  us  consolidate  the  lot  four  letters.  The  derived  consolidated 
element  has  a  probability  of  O.i'v”.  an  i  must  be  inserted  in  (be  alphabet 
b -tween  P  and  I  .  I.et  us  yo  tan  imb  the  same  operation  with  the  last  ''our 
letters  and  write  the  derived  conse 1 i dated  element  with  a  total  probabj'jtv 
of  '.a.i;,  in  the  appropvi  at  e  place  in  t'-e  alphabet  '-etween  and  I'e  con- 

*:rii'  in  the  same  wav  until  there  remain  ‘'our  letters  i\,  !•' ,  and  a  eon- 
s  '!  iilate  i  ■lement'',  to  wltich  are  ascribed  the  code  sVrbo|s  n,!,f  and  lVo 
then  compile  code  combinations  for  "Ko  leMers  wltich  have  entered  into  the 
consol  i  dat  i  or c  (bv  tjroups  of  m  letter-;'.  'be  whole  nroeess  it"  const  met  i  nr 
"tie  cod-o  is  el  ear  from  Table  Z.l. 


inallv  we  will  have  deri”ed  the  followim1  code  table; 


A  u  L  I  i  I  |  .mi  N  leun 

B  C  ini  k  I  'I  S  mill 

V  I  Zh  l"_‘  L  1"  P  m".’ 

g  n  z  I" ;  m  i  ’ ;  r  i  m 


It  is  ease  to  see  that  the  derived  code  i -;  irreducible  and  that  t ’m 
most  probable  sign-;  have  the  shortest  code  con1'  j  ra  t  i  ojis .  'be  n’eraoe  number 
of  svnhols  per  letter  i 


ft  V  /'  ( t ,  |  'i ,  I ,  I'd 


The  redundance  of  the  derived  code  is,  accord  i  nr.  to  I  \  1 5 


iw  I 


/tl.l 

ii  I  jo 


i  .  i- .  ,  almost  1"  tiro-;  I  i*s>.  than  r redundance  U  the  me-;  save  source 


T 


First 

i  Second 

Hi  rd 

.  t  !  b  Const  r,ict  ion  o'  Code  tomb  i  na 

Conso  1  i 

-*■  fonso  1  i 

-*  f onso 1 i 
| 

-  Ton  .o  1  i  - 

■  .  ,  lions 

da  t  i on 

:  da  t i on 

nation 

da  t  i on 

_J 


It  may  he  shown  fl|  that  the  code  derived  1  v  1 1:  i  s  a  1  yet'  i  t  hr 
in  the  sense  that  with  r.iven  source  and  a  riven  code  '■  i<e  r  it 
sihlc  t  o  construct  a  code  w'th  less  redundance.  It:  the  i.iv  when 
is  .a  whole  number  this  code  :s  full:  this  means  th  it  are  sentence 
may  he  obtained  as  a  result  of  encoilinc  some  ness  a  re .  i  *  is  o'-vi. 
this  condition  is  always  fulfilled  for  hinarv  codes  i-  -  '  . 

hot  us  observe  that  since  'he  redundance  o''  such  a  noaon  i 
verv  small  all  svmbols  in  anv  tvnical  code  seuuence  must  'w  "tic  .  m 
with  almost  identical  freuuenve  and  i'n  i'.i'u  !  is!  ir  cor.m  >  •  i  ons 
the  svmbols  must  be  verv  weal  <  i  .  <  • .  ,  the  conditional  or  dd  1  < 4 
svmbol  apnea  r  i  nr,  when  the  preceding  .  j  <  ire  ’  nown  d  •  •  ‘  ers 

from  the  total  pro'eihilite  that  this  '-•.•p’>o!  v*.  i  si  e'poar  . 


hot  us  re.  on  to  the  more  general  ..we  where  the  messare  a 
Marlovian  and  its  redundancy  is  dote  rn  >  .ned  not  on  1  v  'n-  t'-o  no’uo'i 
''ability  distribution  of  th  letters  ’nit  ilso  >n-  the  . 1  e-  -  udn-  , 
probabi  lities  on  wh.it  letters  precede  1  a  riven  letter.  i'e  wi  1  1  • 
two  possible  methods  of  eliminatinr  redundance  in  vodittr  t':e  tm-s' 
suchi  a  source. 

The  firs*-  method  is  as  follows.  'or  ever'  state 

is  :i  "particular"  cole  constructed  as  dost.  r  i  Nsl  n'eve  w ; !  •>  respe, 
eond  i  t  i  on, -i  1  probabilities  of  the  lerter  which  occur  in  stati 


words,  rho  com*  is  irons  t  meted  .is  .in  aggregat  e  of  tin*  imlividu.il  iodes  for 
overv  state  S.  (i  -  l,...,r)  of  the  source.  ‘;inoo  state  is  uniuiirlv  do- 

i  i 

termined  by  the  preceding  message  elements  it  is  1  nown  both  in  tlie  t  r.ans- 
mitting  and  the  receiving  devices.  We  remind  the  reader  that  hero  we  are 
discussing  a  noiseless  channel  in  which  overv  transmitted  element  is  re¬ 
ceived  without  error.  Therefore  it  is  always  known  which  of  the  particulai 
codes  is  being  used  for  the  following  element,  and  this  ensures  the  unique¬ 
ness  of  encoding  and  decoding , 


This  coding  method  comp  let  el v  eliminates  redundance  caused  by  pro¬ 
babilistic  connections  between  the  message  elements  or,  as  is  said,  effeet> 
complete  decorrc I  at i on ,  At  the  same  rime,  because  the  optimum  nonuniform 
."de  is  employed  in  every  state,  redundance  caused  by  nonuniform  distribu¬ 
tion  ef  probabilities  of  the  elements  is  entirelv,  or  almost  entirelv, 

■* !  i  mi  na  t  ed, . 


!'he  'is. 
*he  need  to  t 
•r  to  use  a  i 
ire,  however 
the  el  erne'  *  •- 
to  ext  r  !  .r 
peered  e!r~< 
"d  i  ‘fo rerc  " 
Cede!.  .die;- 

sour  •  :  ■  • 


of  this  method  in  practice  is  genera  1 1 v  made  difficult  bv 
-■  automatic  change-over  devices  for  encoding  and  decoding 
roup  of  sue1',  devices  for  all  states  of  the  source,  bounces 
frequentlv  encountered  with  such  probabilistic  lies  b< tween 
each  that  the  method  of  decorrelation  described  above  reduces 
:  mi  ot'  a  sentience  of  elements,  i.e.,  the  tiredict’on  of  an  ex- 
t'rom  1  now  1  edge  ef  the  preceding  elements.  Here  the 
•etwi'i’n  tlii'  predie'ed  element  and  t  he  one  actual  lv  chosen  is 
tin*  s-inoept  ’  lifference"  is  •roporlv  defined  for  a  given 
'ift'i  ••"tiers  have  ''ar  less  powerful  proh.oh  i  I  i  st  i  c  ties  than 
i!  elements  M  -lie  message. 


rnt :  n  :■•■::■  o1 
from  '■•:•.  •  x 
the  aver  a.-' 
i  ndependent , 
in  a  tenth  •■  t 


.  .  ;  show  t1,  i  s  t--v  a  simple  example.  let  a  communi  cat  i  on<  svstor 
"ransnit  mes  wires  I'xout  t  strength  of  a  current  put  out  'n- 

e!"ctric  p'wer  st  it  on.  In  order  fr.p  these  messages  i.i 
;  ••  ’  ln  •  •••>•;•  correspond  •  'he  strength  of  the  iitrrenl  at  certait. 
f  ttm"  .  e .  g  .  ,  overv  ''.1  sect,  and  the  measuremi  nt  <  must  also  t»e 
i  ••  ■•  i  i  •'  a.Mir.icv  i  sav ,  iccurate  to  one  ampere"' .  ''lie  alphabet 
ur  !;o  :  of  whole  numbers  from  vero  to  the  v.i  Itie  of  the  maxi- 

si;'!"  current,  wliic1'  'be  station's  protective  apparatus  prevent  s 
,  •  x  v  "p. !  p  1 .  These  nu-''  eps  .are  not  ,  o'"  course,  ecu  i  rrobab  1  e  since 
tlues  t.'pv  the  greatest  probability.  !n  addition,  thev  ire 
nf,  :!'••■  t  b  e  "roba1  i  1  i  •  v  t*v,t  an  abrupt  current  change  will  occtt: 

h  't  •  ■  ■ 'tid  is  wrv  smali.  It  is  most  pro'eiMe  t'va*  the  current 


strength  will  rt  ma  i  n  ("with  accuracx  to  one  ampere'  the  same  that  it  was  a’ 
the  previous  re  r.g;  current  of  i  ampere  have  consi  .er.d’le  pro¬ 
bability,  chance  !'  •  amperes  have  less  prob.abi  I  t  tv ,  etc.,  and  changes  lv 

tens  or  hundreds  ‘  amer-'s  have  verv  little  probability  at  all. 

Here  we  hav  :  •*  -nc  ■  i  "av'o'i aat  source  whose  state  i  s  let  erri  tied 
•  n  a  first  approx  i  ma  *  •  at  n  !  •  last  -cssago  I  current  <♦  renC  h  a*  a 
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values).  Moreover,  all  particular  proh.ab  i  1  i  tv  distribution1;  diH'er  from 

each  other  only  by  the  position  of  the  most  probable  value  (equalling  the 

value  at  the  last  moment  of  reading)  a  ml  can  be  found  bv  shifting  the 

graph  of  probabilities  a  1  ong  the  current  axis,  as  Figure  2. -I  shows.  This 

figure  gives  the  distributions  of  conditional  probabilities  pfl  /I  -1)  of 

n  n 

the  measured  current  strength  I  if  the  result  of  the  preceding  measurement 

was  1  Consequent  1 v ,  the  differences  1  -!  ,  do  not  depend  (more 

n- 1  '  •  n  n- 1 

exactly,  loosely  depend)  on  the  preceding  values  of  current  strength  .  He 

will  regard  the  value  T*  =  1  ,  .as  .an  extrapolated  (predicted)  value  of 

n  n-1 

current  strength  1  .  Then  only  the  difference  between  true  read-out  value 
I  and  extrapolated  value 

/’„  /„  I,-.  , 

need  be  transmitted  over  the  channel. 


Conditional  (Vo  hah  t  1  i :  i -s  of  Messaqes 
from  a  Markovian  Source. 

We  shall  use  an  nptioutn  nonuniform  code  for  these  differences.  'rhen, 
of  course,  the  shortest  code  combinations  will  mean  that  the  current  strength 
has  not  changed,  or  has  changed  hy  ‘1  oapere,  while  longer  code  combinations 
will  correspond  to  more  subs'-, an*  i  a !  changes  in  current  strength.  It  is  easv 
to  see  that  this  method  of  decorrelation  bv  t ransmi t t  i ne  the  differences 
between  current  strengths  is  one  of  fb,>  variants  of  the  method  of  particular 
codes  for  ever’-  stale  of  the  source.  !:t  real  i  tv,  everv  code  combination 
<locs  in  fact  carrv  a  message  at  out  current  strength  at  the  giver  moment, 
hut  is  order  to  decode  the  combination  the  stat"  of'  the  source  must  bp  !  nown , 
i.e,,  I  in  the  given  example'  the  current  strength  at  the  preceding  reading. 


•In  realitv,  of  course,  these  d  i  st  r  i  but  i  ons  ar*'  not  ent;re!y  identical  and 

are  nartieularlv  distorted  when  !  ,  is  close  to  zero  r  te  current  maximum, 

n  -  1 

but  the  probability  of  thise  extreme  stares  ■  s  snail  and  the  distributions 
may  be  considered  identical  i a  shape  w . t hour  anv  mart  iculnv  error. 


The  particular  codes  in  this  example  differ  from  each  other  onlv  *>v  the 
"initial  reading  point."  Let  us  note  that  this  method  of  eliminatim1  re¬ 
dundancy  in  telemetric  systems  is  of  practical  value  because  it  enables  us 
to  reduce  the  requisite  carrying  capacity  of  a  channel  and  to  utilise  with 
more  efficiency  an  existing  multichannel  line  of  communication  to  transmit 
the  results  of  measuring  a  number  of  physical  magnitudes. 

Another  method  of  decorrelation  is  to  utilise  the  a  1 nhabet -on  I  a re i nr 
operation  with  which  we  are  alreadv  familiar.  We  thus  form  a  new  septa  e 
alphabet  and  if  the  number  of  letters  ,■>*'  t  be  initial  .ilrh.drt  t.huh  b.ue 
gone  into  one  "letter"  of  the  enlarged  alphabet  suhst ant i a  I  I v  exceeds  the 
range  of  action  of  the  probabilistic  connections,  the  connection  'u. tween 
elements  of  the  enlarged  alphabet  may  i<e  disregarded. 

As  was  shown  in  Chapter  1  (see  (  1  .  1  •!]  ]  total  redundance  docs  not  in¬ 
crease  when  an  alphabet  is  enlarged;  hence  the  decrease  in  redundance  cans..' 
by  reciprocal  connections  must  bp  accompanied  bv  a  corresponding  increase 
in  redundancy  as  the  result  of  unequal  probabilities  "f  t'>e  appearance  of 
various  elements.  Actually,  the  enlarged  alphabet  of  a  message  source  is 
■always  characterised  by  a  more  uneven  distribution  of  element  rre^ni’ i  1  i  t  i  es 
than  is  the  original  alphabet. 

Hy  use  of  an  optimum  nonuniform  code  to  encode  the  on  1  u red  alphabet 
we  may  practically  completely  eliminate  the  redundancy  contained  in  the 
message.  Therefore,  the  process  of  e' initiating  the  redundance  of  a  Mari  vi  i 
message  source  reduces  to  two  operat  ions--decorrel.it  i  on  \  nsjnr  r1”'  ”.ir 
ticular-code  or  the  alphabet -enlargi nr  method'*  and  encoding  ui*b  :'’e  op¬ 
timum  nonuniform  code  f a  1  . 

Many  countries  use  special  codes  for  official  t  e  1  eg  rat'1:  i  c  •"rn,s- 
poiuience  between  the  different  ministries  and  departments.  ’hesp  codes  usp 
short  combinations  for  transmitting,  often  recurring  sentences  and  expressing 
[(•]  (typical  sequences  for  a  given  message  source',  while  rirolv  encouniir"d 
sentences  are  transmitted  in  the  ordinarv  wav.  Ibis  js  ,t  tvoical  »  x.itrple 
of  the  elimination  of  redundance  by  enlarging  the  ali'h.-d'et  He  whole  sen¬ 
tences  and  parts  thereof]  and  >yv  efficient  encodinr.  \  c«  ns  idem1' le  s.iving 
in  telegraph  expenses  is  also  roa lined. 

The  described  methods  of  eliminating  redundance  permit  effective  use 
of  the  carrying  capacity  of  a  noiseless  channel.  They  are  also  useful  in 
eases  where  a  large  volume  of  informat' op  must  be  stored  in  various  ’"omorv 
devices.  Let  us  note  that  economy  in  channel  carrying  capacitv  or  in  remorv 
device  capacity  results  in  the  last  ana  I  vs  is  in  actual  monetarv  savings,  in 
reduction  in  sice  and  weight  of  instrumentation,  etc. 

flic  elimination  of  redundance,  however,  also  has  a  significant  neeativ 
aspect.  Code  symbol  sequences  of  an  optimum  nonuniform  code,  when  they 
are  stripped  of  redundancy,  prove  to  be  veto-  "brittle"  under  the  effect  of 
noisp  in  actual  channels  or  in  actual  memory  devices.  This  brittleness 
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consists  in  distortion  of  one  of  the  seinbols  in  a  sentience  bring  enourh 
to  make  impossible  correct  decoding  of  tM  letter  containing  the  «enbol 
as  well  as  a  number  of  following  letters'. 

l.et  us  clarify  this  with  an  example,  let  us  assume  (hat  t’u'  follow!  nr 
telegram  is  transmitted  over  a  commun  i  cat  i  on  channel:  "IV!  M  \l  I'Al’VI '•c;  l'!\'!8|||P 
8000  CUT  (lATIII'Rl’P. "  If  this  tolc I'raji  was  encoded  in  a  nrimarv  uniform  code 
without  the  redundancy  removed,  th>n  erroneous  reception  of  one  or  •••con 
several  isolated  code  svanbols  will  lead  onlv  t«>  erroneous  decodim1  of  one 
or  several  letters.  let  the  telegram  be  received  in  t  tie  folluwine  for": 
"IVIIIiAT  HARMiST  MM  SHIP  8000  |11VT  (LVnU'.RI  I' . "  I  *  is  obvious  that  the  recipient 
of  this  telegram  easily  reads  it  and  restores  the  sense  accord i nr  to  eontex"  , 
the  four  mistakes  notwithstanding.  This  is  because  of  the  redundano  of  t'he 
Lnglish  language.  Since  the  entropv  ner  letter  is  cons  i  der.ab '  v  les;  than 
the  maximum  entropv  the  overwhelming  number  of  random  sentiences  of  letters 
form  atypical  (meaningless)  concatenations.  Those  include  what  was  receive! 
instead  of  the  transmitted  telegram  and  fot  this  verv  reason  the  tvnical 
(meaningful)  sequence  which  in  all  probability  was  transmitted  over  the 
communication  channel  mav  he  determined,  let  us  make  the  a  propos  observa¬ 
tion  that  if  the  number  6000  had  been  erroneous lv  received  instead  of  8onn 
it  would  have  been  impossible  to  correct  this  error  from  the  context.  'Ibe 
reason  for  this  is  that  when  numbers  are  expressed  in  numerals  redundance 
is  abruptly  reduced  since  every  numeral  sequence  has  meaning.  The  number 
could  have  been  written  in  letters  ("eight  thousand"''  to  increase  fidelitv. 

Let  us  suppose  that  the  same  telegram  was  encoded  with  the  snecial 
departmental  code  which  was  mentioned  above  so  that  redundance  was  reduced 
to  a  minimum.  Incoded  with  a  literal  alphabet  this  te  lee  ram.  mav,  for 
example,  have  the  form  K'MIIA  800n,  which  can  be  transmitted  over  a  tele¬ 
graphic  communication  channel  considerable  faster  and  more  cheat  ie  than 
with  a  primary  code.  let  us  assume  that  one  letter  was  distorted,  in  tran  - 
mission  and  the  code  sequence  received  was  KT'flIA  8uoo.  if  a  code  eliminates 
redundancy  efficiently  enough  it  has  the  property  of  comp  1 otenoss ,  i.e., 
any  symbol  sequence  is  typical  or,  in  other  words,  has  a  r.eaning*'ul  context. 
In  the  given  case  the  telegram  received  may,  for  example,  reap:  "because  o1' 
natural  calamities  the  crop  on  8nnn  hectares  has  been  lost."  It  is  no 
longer  possible  to  correct  the  error  from  the  context. 

Therefore,  every  elimination  of  redundance  is  associated  with  the  risk 
iif  losing  fidelity  when  messages  are  transmitted  in  a  noisy  channel.  The 


'it  should  not,  however,  he  thought  that  after  one  erroneous le  received 
symbol  the  whole  remainder  of  the  sequence  will  be  wrongly  decoded.  As 
Hilbert  and  vtoorc  [89]  have  shown,  optimum  nonuniform  codes  general le 
possess  the  property  of  autophasing,  as  a  result  of  which  the  possibility 
of  correct  decoding  is  restored  after  several  erroneous le  decoded  signs. 
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limited  menorv  in  u*'ich  ;i'nvi'r<  i  on  nro1'  d-  i  I  i  •  i  o>-  !e>  end  on!\  on  a  finite 

se;menf  of  the  nreoed  i  tv  sentience  of  svmbnls  f~l  er  c1,  a  nro  ] «;  ihhc*  .ire 

■escribed  l\  .1  finite  number  o*‘  sr  ites  sen  n  as  such  mode  is  i*  i  current 
t  ate  can  *'•'  dot  erni red  from  •  he  nrecodinc  t  ire  and  »'e  I  ;i  s  f  <er’,,i'l  tr.ins- 
"  :  1 1.  !  \<]. 

\i\Tr>!  i  ru:  t  o  s'r  it'nen  ’  ■-  t^e^rcr,  ni'i'-.ii’e-;  f  r  >.  retiree  with  i  o  f- 
t  rol  I  able  rite  err:  ,se  ere'Ji'i!  as  to  t  ran « mi  t  ther  as  men  ra  t  e  1  v  is  ie- 
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trmsmitte'  is  accurate!'  .as  desired  it’  *  ur  ”r  oduct  :  1  *  v  •'*'  t’-e  source 

i:'  \)  is  than  the  carrvim:  canacitv  <f  the  'birnc! 


he  u  i  !  note  tha*  the  -imire  -at-  u*if\  <f  1  discrete  •’■arnel  1  ra. 
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method  of  decoding,  the  decoder  must  store  all  possible  code  i-.m  *•  i  nat  i  ops , 
permissible  as  well  as  forbidden,  i.e.,  have  a  momorv  sire  euuil  to 
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exponential.  As  a  result,  with  a  value  of  n  equal  to  >u,  'he  uiro-l  size 
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but  in  proportion  to  a  rather  spall  power  n  f 1 ” .  1  1  . 1  ’  1  .  Vt  *  i  •’  r  i- 
t  ior.  about  these  codes  will  *>e  presented  it'  t'>r  toll  a:  or  "ir  '•< . 

detailed  c  1  a  s  s  i  f  i  ca  t  i  >  •>  of  suggested  corrector  c  -  h--  ;s  ''ll. 
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With  .m  increase  in  n  the  l.anlaee  ft  met  i  on  I'l-.'-in'  r:r'  i  il  i  v  ipp  rone  h 
ere.  Therefore,  for  any  positive  •  am!  ,  it  i  s  possible  t  <  *'  i  n<  •  m  n 

ik'h  tlutt  with  a  probability  pr-ater  tlian  !-••  the  I  la  mn  i  nr  distance  het  veep 
m  "air  of"  rs'idor  I  v-  selected  cede  cerh  i  ra  t  i  ens  wi  1  i  ’>0  ireater  than 
-  '■'p. 


Fhe  J  i  c  c  u  s  s  j  presented  viebls  .  n  ]  \-  a  uua  1  i  t  a  t  i  ve  eon  *’i  t’P  :  t  i  up  of  th 

1-  .'t'  ran.h'P  selection  u'len  :t  is  "oss  i  h  ]  e  wit1-,  a  t'  roh  d'  i  1  :  t  v  lose  'o 

’  i  i  tv  to  o’  '  a  i  n  1  lari’i  I'lnrinr  distance  ''etKeett  perpi  ss  j  l»  !t>  ,-ode  jea¬ 
lous,  'or  t  !i  i  s  purpose  jp  n 5  <’  ;■  t  ileterrine  the  rate  of  t  rarspj  <s  1  i.p  o1' 

r.  fennat  i  "p  in  r.indep  codinr  v.e  u  i  1  1  •  ■  a  !  ua  t  c  the  'iroha1'  i  1  i  t  v  o'1  inrerree? 

m; i  ti r  when  n  1  . 
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Hut  the  ratio  r/n  is  less  than  p  +  .-  wit!:  a  prohnMlifv  o('  I-., 
ties  i  I'.n.at  o  p  +  -  p*  .  I'hon  with  a  nrohub  i  1  i  t  v  of  1-: 


p9n 


(I 


/’•) 


r*)’\ 


\ny  of  those  \  coni'*  i  nat  i  ons  c;  in  ho  porini  ss  i  h  ]  e  with  n  nroh;ihi!:t\ 

p 

\'  J  '  and  the  probah  i  1  i  tv  that  not  one  of  flu*  !  comb  i  n  a  (  i  ons  (except  a 
it  1 

Mn.it  ion  \  which  was  known  beforehandl  does  not  i*e!oni’  to  those  prr"’is<- 
:  s  I'o.u  i  !  ’ 


(' 


i  ' 


Puis ,  tin*  rrobabi 1 i tv  pin)  of  correct  ilecoilinr  of  a  reeMvod  combinati< 
is  evaluated  In-  tin*  to  1  1  ow  i  ill’,  expression: 


Q  (' < 1  •  1 1  -  j)  ^  1  j  ■  I  i  L 
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e  ’ho  ! 

■  -  i  r  i  *  I'p  i 

hasp  i  s 

w  i  !  !  i:it  r'dnce  still  .mother  delimit';  ■•* : 

C  l*[  I  ;  /'•  1  ■,*./'*  I'  /''I'  -'.ll  /'''I 

I*  cm  •••i*.  i  !  v  '*(•  seen  -hit  ■  '*  is  *h>n  *  !u*  cart-vim*  ov*ioit\  •:  ♦  N 

ch  nine  1  : 


(.'  f  |l  ;  ’/>  I*  /’  :  1 1  /’>  !"•;  1 1  /'!■ 

.  i  i'mm-o  idn  <  it  i  s  ipp  reaches  '*ew  r  i  t  i  nr  d .  b’ 1  o  ‘  o !  1  o*.  • 

n 

•'  3  \f  • 

we  see  th  if  with  m  mcrea-e  it-  t;  ‘,*.-  i1,  i  !  i  t  \  c  correc*  dec  *  ‘ •  r 

ipp  roaches  I-  ,  on  o'tidi  *  nai  that  \  s,i*  nid-'s  the  i  tieoi:  1 1  :  \ 
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Specifically,  this  will  So  true  if  Nf1  =  --  dv  •  Cons  i  tier  i  ng  that 

with  a  sufficiently  large  n  the  magnitude  .  may  he  as  small  as  des  i  re<l  and 
the  magnitude  C*  as  close  as  desired  to  C,  it  can  he  asserted  that  with  1 
randomly  selected  code  the  prouab 1 1 i tv  of  correct  decoding  of  a  received 
combination  is  as  close  as  desired  to  unity  ffor  a  stiff i cient  I v  larre  nl  if 
the  number  of  permissible  combinations  is 


n 


Finally,  we  will  determine  the  rate  of  information  transmission  with 
such  coding.  Since  the  probability  of  correct  decoding  is  as  close  as  de¬ 
sired  to  unity,  the  amount  of  information  transmitted  over  a  channel  is 
equal  to  the  entropy  of  the  code  combination.  If  all  the  permissible  com¬ 
binations  are  selected  independent  lv  anil  eou iprobabi  1  v ,  the  entropv  of  a 
code  combination  is  equal  to  log  \  and  the  entropv  for  each  transmitted 
svmhol  is 


II (i/)  1  bp  A',. 

n 


'  .VIM 


It  follows,  that  the  rate  of  information  transmission  is 


or,  substituting  u'.-lfO 


I  t./.  d)  vlli’ii  ,  '  1 

/•l.v.:/')  ,  J*: 

n 


t r 


Kith  an  increase  in  n  the  seven  1  term  approaches  :ero,  i  e  ,  the  r  re 
of  information  transmission  can  he  as  close  ic  desired  to  the  cairving 
capacity  of  the  oh ann-'] . 

Mnderstandah  1  y ,  with  "he  !osori>'od  r.andem  seiection  m'  g  u !  <'  t^’ore  ;s 

a  certain  probability  of  s<«  ]  ert  i  nr  a  "’ad"  c'de.  'or  o\.p"p!<  ,  ir  mav 

happen,  although  wit1'  V’  rv  slig.lt'  r  rehab  i  1  i  tv,  that  two  eomh  i  nat  i  en<  o  ■' 

\  and  h  iv  i  1  1  coincide  wit*’  me  me'her  or  d.  tffer  in  oniv  one  d :  g  1  *  .  ‘''.it1; 

transmission  of  combination  V  i*  'ill  he  decoded  a-  wit'-  gr-'i*  p  'ssjhj  - 
lit>',  and  vice  versa  .  It’  rh'  •  occur  *  for  se'cer.il  pairs  0!  c  'm'- mi  i  ;  i  ons  , 
such  a  code  will  not  provide  for  high  fidelitv  in  dec  ding. 

The  prohabilitv  of  correct  reception,  evaluation  of  whig*  is  given 
in  ('d.4‘1,  is  in  essence  a  joint  prol-ab  i  !  i  t  y  o*  two  events,  i.e.,  ‘he  selec¬ 
tion  of  a  "good"  code  and.  correct  decoding  using  this  c  al".  \  more  det  a  led 
analysi.  [f]  leads  to  the  following  result.  \tnong  random! v  selected  codes 
there  are  "good"  codes  for  which  the  preb.ah i  1  i  t \  of  incorrect  decoding 
I'fnl  -  l-Ofn),  with  1  suffi  cien:  lane  n,  follows  the  ineuualitv 


/*.//,-  .!• 


. . 
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where  \  is  a  certain  coefficient  which  chances  slowl'-  with  an  increase  in  n; 
lifRl  is  a  function  of  the  rate  of  i  n  forma  t  i  on  transmission  u  -  v/n  lop  N 

which  is  positive  when  I-  •  ('  ami  equal  to  rero  when  if  -  f. 

\s  far  as  prohahilitv  I*  of  selectim?  a  "had"  code,  for  which  l.'.TRi 

V 

does  not  hold,  it  also  approaches  rero  with  an  increase  in  n  and  much  more 
rapidly  than  the  probability  of  incorrect  deem!  ini’.  Thus,  if  n  is  so  selected 
as  to  provide  a  sufficiently  small  nrohah  i  I  i  t  v  of  incorrect  decodinr  (.’.•lR'i, 
a  randomlv  selected  n-d!pit  code  will  he  pood  with  a  prohahilitv  of  prac- 
r i ca 1 1 v  1  , 

It  would  seem  that  the  results  obtained  solve  cornu  I  ete  I  v  the  pmhler 
of  error-free  transmission  of  information  at  a  rate  close  to  the  crrrvinc 
capacity  of  a  constant  symmetrical  hi  nary  channel.  However,  practical  use 
of  a  purely  random  code  encounters  obstacles  which  are  insurmountable  at 
the  present  time,  and,  it  seems,  will  remain  insurmountable  for  scores  of 
rears.  The  fact  is  that  storage  i  r.  *  he  memorv  of  a  decoder  or  encoder  of  at 
least  all  permissible  combinations  and  comparison  C  them  with  the  received 
combination  is  the  onlv  method  of  encodinr  am!  decodinr  i  when  us  i  nr  a  random 
code),  hi  t  h  values  of  n  which  provi  'e  for  su  'T  i  e  i  erf  1  v  small  pro'vih  j  l  j  t  i  es 
of  incorrect  decodinr,  the  required  sire  of  merorv  pro.it  lv  exceeds  that 
achievable  by  modern  teehnoloyv. 

It  is  for  i  ust  this  reason  thi*  purelv  r  m 'om  col  inn  has  no*  found, 
practical  application  ami  efforts  >»'  researchers  have  been  directed  toward, 
regular  or  semi -recul ar  methods  of  col'ny  *’or  which  it  is  possible  to 
formulate  certain  rules  for  conversion  o'"  messages  into  code  combinations 
and  also  rules  for  decodinr  with  correction  am'  'erection  of  errors  ami 
a  1  so  fo  construct,  in  accordance  with  these  rules,  rolati'elv  simple  lerio 
c  i  rcr.  its. 

2.6.  Constant  C.vmmetrical  Channel.  Regular  Coding 

Tln>  nn«r  widespread  amopc  rerii!  *r  codes  are  svstemtic.nl  codes, 
prohlems  in  the  const  met  i on  of  which  ir”  considere'  in  the  alrebraic 
theorv  of  codinp  usinr  'he  apn-irattis  ■>''  modem  nlyeb*M  ri  l,!',ltl, 

\  sv;tematic  in,!''  code  arour.ts  ro  a  set  •  *'  t*  -  licit  code  cor1'  i  na  t  i  ops 
of  which  i  dinirs  lusuallv  flu'  first  ones  represent  the  result  of  prim” 
cod  i  nr  of  a  mess, are.  fliev  are  called  i  "rormn '  i  on  1  i  r,  i  t  s  .  the  remini  re  >'-i 
dibits  are  formed  in  accordance  wit!)  certain  rules  »'rom  the  information 
dipits.  ihev  are  called  the  checl  iny  ,  •i',-r(’ft  i  nr'  dirits  and  thev  serve 
the  purpose  of  detect  iru1  and  correct  i  tip  errors.  '  o>-  example,  the  .-ode 
f.41  is  a  code  in  which  a  se>a>n- ’lement  rode  -oH'in.iti  m  contains  Tour 
information  svmbols. 

In  other  words,  the  process  o«’  encodinr  a  mess, are  max'  'm  imarired  as 
a  succession  of  two  procedures-- •'  rst  ,  enr.idinr  mi  a  unirorm  l-dirit  non- 
redundant  code;  and  second,  assjrninr  n-1  corrective  dirits  rormulate'  'v 
certain  rules  to  each  of  the  cede  combinations. 


<V'tffiirtrtAmir>Tr-'nYf  t-)»^  T  f  fhH-jftaTrtlrt  tWYr- 


The  number  of  pcm  mi  ss  i  I'  1 e1  code  coin1'  i  n :  i  r  i  oik  ip  ;i  svst  emat  i  r  eoe!e-  is 
m^  ,  from  t  h  I  ^  the  code  ri'ilnmi.'iiu'v  rn.i \’  in'  easilv  deti*rmi  i>«'< 1 : 


II  (  \  l-  v  v„ 

'  '  i  ' 


t  n  k 


f  \  l(M 


l!u'  ce'rrect  i  ni1,  s\mbo.s  are  form'd  In-  linear  operat  i  on  s  ,  dot  i>  rmi  nc! 
ovit  a  finite1  field  a:;.!  >>  rodu  •  i  h !  c  ovor  the'  information  <\t''o  !  s  .  In  the 

i  ou  I  a  r  c":e  whe're  is  a  prim-  thi'se'  e’ne  ra  t  i  mm  arc'  conr  p  r  "  t  with  ■ 

:•  -.on  no1:  -  \ '  w . »» • ;  ’  nri  nd  *  '•••  ••••a  ‘<*r  tha»  '  w",  i  <  >- •  jr<*  •«  •  «• 

\  >rd  B  arc  r..!cd  i  .'e"’ i rah  1  e  modulo  r  (writ  tent  \  i"<  m  1  t”  1  !  if  I  ■  >  t  !  i  <o 

t'‘"ae  numbers  i:ire  t 1  •  ■  wimo  re"-’ a  i  tnli'r  when  divieled  l>v  r.  'or  I'.ximnie, 

il  (pod  5’'  ' r  S  '  (pm!  “  .  'h .  fc>rr  oorrortinr  svr1  !<  oortain  in- 

I'oiPition  svinl’iiN  ( re”  i  t  ed  he  the  numBo  ra  from  11  to  m- !  1  are  added 

mod  1 1 1  o  m.  This  means  th.it  after  a  r  i  t  hmet  i  e  addition  o‘  these  numbers  their 
stir,  is  replaced  h-  the'  least  wltolc'  non-nerat  i  vc*  numl’or  comoa  r:d' I  e  to  this 
sup  modulo  p.  i  or  the  "least  remainder  modulo  m""i  .  ''-us,  for  example, 

1  »  ’  ('  (mod  o'), 

!  (mod  .Vi  , 

!  *  |  e'e  pod  .' )  ,  c't  e  . 

It  is  obvious  •  *'  i  r  these1  ope-rat  i  on  ^  produce'  nr.  net's  •  -op  o  r.  "’-I 

wh.i  'h  p.av  represent  reive!  io”  ■■  \  >  1  ■- .  By  at'propri  at-  <"!(■  't  ini  of  the 

eauations  f  >>  r  •‘•■rni  n,*  *  he  corree.’in.  svnhols  we  par  t  rue'  •  'ode  with  a 
I'i’vn  minimum  lianmine  ii  st  ance1  d  .  . 

r  i  n 

!\’;*he'Ut  ro  i  t;  c  into  the  !e*  i  i  1  s  of  t*’e  'heearv  ’*  :,’e'.'tinr  codes, 

which  is  vet".'  t  horourh  1  v  set  sir’1:  in  a  mono  it  ’h  Mil,  e-.e  :  !  r  i  ve  an 

exartp  !  •'  at  cops  r ’-uc  *  i  in’  code  ~.  '  'a  r  p  the  ,'rsir  i'  i  "  •'  ’’  ’ws  , 

four  dicit'-  of  the  .-ode  c-’pl  •  r*»  ■.vtiP'e-.l  '  v  i  n'orma*  i  '.aT'ls. 

!se  will  designate  t  i  Pe1  a  ,,  a  .  "•  re'r.a  i  n  i  pr  t’1.  re*'  'ir’ts  ire  ocuipie-' 

w 

'' v  ce’rrection  svtrhols,  whir'-  we  will  denote  >'v  f  l’1t  1>_.  "n  sv'.pis  i^ 

nav  adopt  value's  ,t  "I",  to  he  let  ermi  tied  '<v  th<>  codec'  rte'ssai’e.  'I’he 

s'."'l'ols  i- .  are  .'.eterminei!  !•••'  the-  cuiiat  i<Mis 


«i-|  a,  :  <i,  •  \  r>.  ) 

a,  \  n,  ■{  e/,  !  />,  0, 

«.  i  «.  1  «.  :  \  I 


i  1  -an 


where  all  addition  is  modulo  '.  'or  examt  le,  if  the  information  svmhols  are1 

I  Mi'  1  ,  the  correction  svnbe'l  s  rust  '  e>  II".  Ip  th*s  code  d  .  ",  We*  easila 

min 

satisfv  ourselves  of  t'lis  if  ue  note  that  reversinr  the  value  of  one1  e.i  t::e 
information  scmhnls  results  in  v a  1 1 if  chance  of  at  least  two  ee'rroction 


■  IVe  would  note  that  in  evervdav  life  we  e’ften  cmr I ov  addition  modulo  1 1 
(or  12)  when  fi  pur  ini’,  time.  Thus,  if  it  is  now  1"  o'clock,  in  ten  hours  it 
will  Be  a  :  MM  A".  Actual  1  v  ,  ! "  *  in  (mod  .Ml. 


symbols,  while  value’  reversal  of  mv  tw<<  j  nform;  t  i  mi  svmbols  I  (•ml  ^  in  valiu' 
change  in  at  least  one  correction  svmbol.  therefore  ,  nnv  two  permi  <<  i  I’  I  e 
codi>  com!’  i  nat  ions  (i.e.,  those  sat i sfving  f2.5(V)  l  differ  from  each  other 
in  no  less  than  three  dibits.  Hence  it  follows  that  opp I ovment  of  this 
code  can  detect  an  error  if  no  more  than  two  svmbols  in  ;i  comh  i  nat  i  on  are 
erroneously  received  or  tan  correct  an  error  if  one  svmbol  has  keen  erro¬ 
neously  received. 

Hie  received  code  com1’  i  a  t '  i  op  is  .-heeled  to  see  wb.  t1-...  i*  s:i  t  i  f  i  es 
the  equations  used  tor  termini’  the  correct  ini'  svmbols,  'he  puitosi  • 
tliis  one  rat  i  on  being  to  detect  errors.  If  at  least  one  of  tb,>s<  euuations 
is  not  satisfied  the  received  combination  is  not  a  pe’-missible  one  and  oon- 
seqwenflv  an  error  occurred  in  transmission. 


lrror  correction  must  tale  into  consideration  which  of  the  euuations 
are  not  satisfied  and  he  guided  hy  special  rules  which  are  easilv  estab¬ 
lished  for  the  specific  code.  If,  for  example,  two  euuations  of  f  2 . 1*01  no 
true  and  one  is  unsatisfied,  then  one  of  the  correction  svmbols  must  b(. 
deemed  to  have  boon  erroneously  received  and  the  received  combination  nnv 
ie  decoded  from  the  information  svmbols  without  anv  correction.  If  the 
first  two  equations  are  not  satisfied,  svmbol  a.  which  is  common  to  both, 


is  liable  to  correction  ("chant: i nr.  "0"  to 
third  equations,  if  unsatisfied,  subject 


"  I  "  or  "I"  t  o  "o"'i  ,  The  f  i  rst  and 
svmbol  a  j  To  correction.  1  f  t  •’  t’ 


second  and  third  equations  are  uns.it  i  s  fj  ed  svmbol  a  is  t  o  be  corrected, 
t'inallv,  if  all  three  euuations  are  unsat  i  s»'i  ed ,  s’.-’l-o!  a,  is  1  i  tb !  .*  to 


correction.  mf  course,  if  two  or  more  symbols  of  the  code  combination  are 
errorioouslv  received  that  combination  will  not  br  correct  lv  'ecod-'.’. 


e  i  ill  now  coi,..;dv  ,  siw-ral  algebraic  rroporties  of  bina>-v  svstem.it  i: 
c  tde*  whuh  y  ’"ir.i  f  examining  detail  thei*’  detect  lie  and  c  '  meet  i  nr  enp-i- 
b i 1 i t i es  . 


\  birarv  svstematic  ede  containing  a  combination  consist inr  of  reroes 
on  I  v  forms  an  \belian  group  w>t!<  respect  t<’  the  operation  of  lirit  modulo 
Th  i  s  means  Hint  after  addinr  redul<  d  symbols  found  in  the  same  i.igit  so, ices 
of  two  permissible  cod"  "omb i nat  i -ms ,  we  obtain  a  combination  which  is  also 
permissible.  Therefore,  such  codes  are  also  called  croup  codes. 

\  grout'  code  may  be  union*  lv  determined  bv  gninr  onlv  1  linear  inde¬ 
pendent  combinations  included  in  it.  "lev  form  a  reneratinr  matrix  r  bavin- 


In  bjnarv  correcting  codes  these  choc! s  are  called  "par it'*  checks"  since 
the  expression  X  •.  n ; ■•!  j»  simple  means  rhni  t’lis  sum  i*:  an  even  number. 


.  ”0  . 


I  rows  .mil  !'.  charms.  Ir  mm 
comh i na f i ons ,  addinu  i  f- •  I  i  ,>  i  t 
rows  at'  .1  yener o i no  matrix, 
wo  will  ohm  in  a  nor'  comhinat 


r'o  ’  to  const  met  .til  ror’.t  i  n  i  nr  code 
mo. lulo  Ji  m  pairs,  In-  throes,  hv  tours,  o’o., 

Spec  i  !’7  ot! !  1  v  ,  hy  midi  nr  .tin-  lino  ti  it  sol*', 
ion  (consisting  of  n  reroos). 


For  the  code  onns  i  ilorod  above  the  generatinr  matrix  can  he¬ 

wn 'ten,  tor  example,  in  the  fol  lowi  no  rorr: 

I  n  n  n  t  n  t 

II  |  0  "  I  I  I 

'  ■  IJ  •  I  1  M  I  I  I* 

n  u  !  I>  I  I 


I 
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j 

) 


It  is  '.’it  *'i  c  i  or.*  to  liavi  t  rone  rati  no  ra*  r  i >  in  'ho  I'temorv  of  'he  -  it  - 
•\!er.  !!i  usi.no  a  lio'ieo  t'or  1  i  o  i  *  -i'v-d  i  o  i '  surra'  i  on  it  is  possP'lo  to 

t  iin  at'.v  rode  combination. 

for  dev 'ding  with  detection  oorrootion  ot'  errors  it  is  s'lt’t'i  o  i  ont 
•  t  have  in  the  menorv  of  the  decoder  a  choc'  ino  matrix  li  oontainino  n-1 
t  w.s  ami  r.  columns,  1 1;  each  1  i  tv  of  this  n.a'fix  ones  are  ronnd  for  those 
::o:ts  vc  I i  r ! '  enter  in'o  t  ''o  correspond i rr  choc!  ino  enua'icn-  (.’’.e1".  It' 
mi r  "X. ample, 


U 


t  t  ;  <•  i  a  ii 

I  I  I  r  I  I. 

!  I  I'  i  n  n  i 


1  on.a  1  !  v  *  t  r 
uv-er  o*’  opemf  ion 

i  •  "  |-s  |T,,i 

’  '  !  t  *  "  i  1  I'  ” 

.-  r:mdor.  end: 


it  .  •  SI™.'  ,\|  m|'|ii|  I  O*’  tile  I'POoPi'i-  ,U1  ! 

:  ■  >  \p.  *n  t  i  a  1  !  .  a  ,  th  ,m  ;neroase  in  •:  hut  nnlv  •■roner- 
:d**ri"o  that  '•  is  *irop.i  rt  i  on.a  1  to  n  '  .  ‘iovert  V'  1  o«- ; ,  *  )■  <  • 
•d  >  oh  ••’Mst  t'O  nor  t’ortPed  ‘or  •  loeodinr  with  t  h  t'  oorroc- 
'tis.  e’t**r  *  !  •.  ,  th*'  e-tmloxi  t  v  •'  ''>e  decodor  i  •>  creases 

1  •  •  :  [  >.•  j  ’  •  > i  j  ;v  j  ♦  j  !  <  ■  ;■  c»  vt t'y' !  f  ^ ,! !  ;  y  1  *'  r 


l  t  u 


n  is  i  •  I’tiulir  i*'e,’.,i-'n  "  is  t<een  d*".-.'*  *'d  to  ■>  var  i  t  !  v 

.■  tde  winch  i  *  oil’.  ■  :  -vcl  ic.il.  his  *  vt'e  o!  code  is  dist*  ne¬ 
mo  o'.'o  :  ot  r*M  rr  moeri  e  •'  so’-l'n  i  a  i  f  i  rorr.i  ss  i1'  lo  o'de 
.  so  1 1  *  ids  • .  ■  a  : '  *  •  r  r  i  *  : 1 '  1 1  *  cert1*!  "at  i  :  s  dist  i  roui  sh  i  no 

is.-,  spi.  I'r.il  lis'inraio  :*ro:'*‘rt  *  **s  of  eve. i cal  oouos  *"a!  «'s  it 
!  \  ir'"1  •  mi  me  '  ' i  nr  sos ;  ers  f  1  1  ,  1  1 ,  !  0  1  . 


t'ro  hi.'f  t  .’on*’!'  1 1  1  rr 

*  '  .*  O  )'  ' 


.it'd  t  r.mspos  ■  t  i  oped  , 'heel  in.*  -.itfix 


S't 


!'  r  ct'vo  i;i  1  cyclical  codes  then  n.iv  *'«*  a  re  1  ;i  t  i  vo  1  v  Finnic  <  .t  1 1  hour,  n  not 
alw.avs  ontimall  procedure  for  .  I  r*  c  i^i  1  i  n  c  which  is  ^  :i !  ]  t'  >  i  maioritv  or  ThroshoJ 
doeod  i  n  c  f  1  o ,  1 111  . 

\monr.  t  lie  cw’ica!  codes  wh.ch  are  intended  ''nr  ;i  const  ant  svmnot ri ca 

channel  tho  best  ;>.re  codes  wit1;  i  n.p-t  i  cu  I  a  r  i  i  ,’«'*•  i*:t  i  c  structure  which  tire 

cm!  lei!  I’ouc-fhodkhuri  codes.  'or  .mv  whole  s  ,in<'  :  there  is  a  Houc- 

f'hodk  luir  i  code  which  corrects  a!!  errors  d  i %  ■  i  <  i  t  >  ]  e  'v  ;  ii.e  h.-ivinc  d  . 

mi  n 

-  dt  *  n  when  n  -  '  -  i  tied  •  ’  '  -  !  -  sr.  tor  example,  t'er  s  :  e  and 

t  -  o  wi'  obtain  a  rode  with  n  oV  1  l>  and  d  .  -  ", 

—  m  i  n 

I  he  introduction  of  eve  I  ion  I  codes  has  made  it  oossjuip  to  construct 
encoders  and  decoders  for  n  on  the  order  or  several  tens  in  the  correction 
of  errors  and  on  the  order  of'  hundreds  in  the  detection  of  errors.  Such 
codes  with  varying  redundtmcy  "emit  a  rather  high  level  or  fidelitv  in 
reception  in  actual  channels.  Nevertheless,  in  rnanv  cases  it  is  desirable 
te  use  even  longer  codes  with  .i  decoder  whose  design  is  as  simple  as  pos¬ 
sible.  Therefore,  efforts  to  find  now  methods  of  construct  i  tie  codes  never 
cease.  Here  mention  should  b(>  -i.-ido  of  the  worl  of  u  .  < ‘a  1  1  agher  f f 0 1  who 
suggested  a  systematic  code,  the  construction  of  the  check  matrix  for  which 
contains  a  random  selection  i  ti  one  of  the  stages.  fhorof'oro  such  a  code 
cannot  be  considered  complete'’.  r<nn;l-ir.  !  hanks  to  the  '’act  that  the  rows 
and  columns  of  the  chock  matrix  out  tin  far  fewer  ones  than  reroes,  this 
code  permits  a  relativelv  simple  procedure  in  decoding. 

Ixtrenelv  promising  are  the  one!  ape  codes  for  which  a  refill'd  of  so- 
iiuen.fi  til  decoding  has  Koen  d-'v !  oped  fl1'!.  'hov  usual lv  "ertaiu  to  random 
codes,  however,  in  their  const  ruct  i  on  then'  js  m  o!o-on'  n<‘  n-rularitv 
which  t'ormits  sirnli'Vinr  the  -'recess  looo.'ir.c. 

'll  tbo  codes  wh  i  c’’  luive  '-e--n  ' :  usm\1  a'-o-cr  ire  '  ocl  codes,  '''here 
also  exist  continuous  codes  in  wltich  the  'a'dtietw"  of  t  lie  transmitted  svr’'ol 
c  ii'not  bp  subdivided  inti'  blacks. 

|;.v  wav  o1'  exanr !  e  we  wilt  .!esor:!'e  'tie  of  t 1  o  r-'ctirrenl  codes,  called 
i  chiiti  cedi'  fid, dM.  It  is  I  i  <t '•  net  i  ■■  e  in  its  extreme  I  v  simple  methods  o'' 
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erased  svmbols  !■  -if.  In  :i  c  t  u.i  1  fact  ,  K\  definition  of  the  Ibimminr  M  s - 

n  1 1' 

’.moo  between  permi  s s  i  b !  e  comb  i  na  t  i  on*; ,  there  exist  ;it  least  two  cembina- 

t  ion-;  ,1  i  ffer  i  nr  hv  or.lv  d  .  d  i  r  i  t  s  .  !•  me  of  these  eon1'  i  rat  i  'ir;  is 

mm 

r  r.insrti  r  t  ed  and  those  dibits  in  ir  are  erased  whir’’  di  ,verer.’  '  ate  from 
'  : *  other  combination,  it  will  '  ■  •-  •  t-’e  * 1  i  •*'  '  ri"i :  s'*  ''urn  .■•ic1. 

It;  ’be  e.me  where  •  iu.  ..-r  |  -  ■  1  joe*  no'  p.  rri*  •!*:*••  d  ■  on  .  •' 

mo :  that’,  d  .  -1  erased  symbols  ,  t'w  probe'"  i  !  i  t  v  *'  in-*  ••••<  or  derodinr 

m  i  n 

(..'•op  p  !  nav  bp  apr  rox  i  m  i !  e  !  *.*  d'firo1  m  the  r  re1':!1-  1  i  !  v  t '  ’  it  of  r 
svml’o!  s  anv  I  .  d'  them  are  eras.-  !  '  '  i  <  rer  o*  '  i  :ir  !'*.•  **:  ' '  - :  i  * '  i  !  i  t  that  a 

|y  1  p 

!  :rrer  number  of  svrtbol  s  ra  •••  be  erased  1  : 

f\  T  1 1  ’/. 1  ’  <  m  ■  ',’sl 

h.  will  note  that  in  the  too-  <•*  v-ode<  w :  t  h  a  r.reat  I'amrinr  distance  ;r 
is  Mos  t  i  b  | ».»  t  i  d.eeode  received  c>de  cor1,  i  nat  ions  oorreot!'.*  e\-en  i  it  t  It  '«e 
case-;  when  alone  with  the  erased  c  <de  •-•vr,’o!<  there  al«o  are  incorrect lv 
received  symbols,  lor  this  purpose  it  is  su  r,'i  -*  i  ent  'but*  not*  always  necossar 
to  meet  the  condition 


u h e r * •  1  i  •;  the  nurber  "f  erased  < - 1  and  1  i*;  t  he  number  of  incorrectly 

-*  o 

r-v'.  f-ii  symbol*  i  r.  *  h*-  •  * ■  *•  d •  con'd  n  it  i  on. 

Indeed,  let  I  svnbols  lcc.it"  I  in  certain  d  i  e  i  ’  s  of  i  received  rcifana- 
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t  i  on  Ip-  erased.  be  wi  1  1  elir'inate  these  dipits  in  all  allowable  code  com¬ 
binations.  Then  we  will  obtain  a  n«'v  ,,-t  of  ,-orb  inat  tons  i  codes  I  in  which 

the  minimal  Hanminr  distance  is  11  .  d  .  -  1  .  I1'  monr  t  be  erased 
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permits  represent  i  in;  .m  aeui.il  ch.ir:ii'l  .!-■  .i  d  i  sp  i vt  rra-'-iit  o  '•  nine  i  urt1. 

pro'vth  i  !  i  t  \  ' f  e r.i sure  ,  i  <  no  t  iuv  i  i  i;  i  !■ !  ■■  ••••  i !  !  .  I  -v  i  Ion  *  ;i .  1  \  ,  •  't  io >  1 : 
system  in  such  1  ehinnel  must  he  nueh  "i'iv  por’’’ov  t  h  m  :r  i  nine!  u'’< 
onlv  erasure  M’  sv'iols  ;  s  in  praotiee  poss  i  !■ !  o  . 
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In  the  part  i  eul  nr  ease  of  a  svmrnct  r  i  ea  !  channel  I’,  p,  the  value  of 

i  ^ 

A  is  cere  and  the  opt  i  mum  value  of  P(dl,  as  was  to  'w  expected,  i  s  n.;,, 

In  the  limiting  case,  where  one  of  the  svmhols,  ”1",  for  instance,  i  •• 
always  correctly  received  (p^  =  01,  while  the  other  symbol  "o"  nav  he 

received  as  "1"  with  prnhahility  p.,,  expression  (2.. Aul  is  simplified 

I 

Let  us  note  that  in  this  case  the  symbol  "l"  is  the  "reliable"  trans¬ 
mitted  symbo 1  since  it  is  always  received  correctly.  The  "certain"  received 
symbol,  however,  is  "0"  since  when  it  is  received  it  can  be  asserted  with 
complete  certainty  that  it  was  just  this  symbol  which  was  transmitted. 

In  the  particular  case  where  p ^  -  o  and  p_,  =  o.f,  tlie  optimum  svmbol 

prohahi  1  i  ty  distribution  is  P(01  -  0 .  -J  and.  I'{11  =  d.o.  Ihe  carrving  capuo  t\ 
of  such  a  channel  is  n.322v  bits/sec.  let  us  observe  that  this  carrving 
capacity  is  considerably  higher  than  that  of  a  svmmetr i c;i  1  channel  with,  the 
same  average  error  probability  ( p ^  -  p.  =  t'.2r>l,  where  it  is  0.199c  bits/se<  . 

The  carrying  capacity  of  a  hinarv  asymmetric  channel  is  r.ero  when 
Pj  +  p_,  =  !.  'n  this  case  the  received  symbols  contain  no  i  n  format  ion  at 

all  about  the  transmitted  symbols  because  the  a  posteriori  an  I  .>  priori 
probabilities  of  the  "0"  and  "!"  symbols  coincide. 

bfficient  error-correct  i  ng-and-dotect  i  ng  codes  f].»  |  may  be  used  in  ,m 
as;  mmetr  i  cal  channel  in  which  p  ^  -  o  (i  v  p.,  so  tl.at  p^  mav  be  :■  r.  i  c  - 

tically  disregarded).  The  theory  of  these  codes  h,as,  !  ewever ,  b,>(M1  little 
elaborated  and  differs  essentially  from  the  theory  of  coding  in  svmmetr ;ca! 
channels.  For  example,  a  code  consisting  of  the  two  code  combi  nut  i  ons  an  I 
11  allows  one  error  to  be  corrected  (change  of  "d"  into  "I"'  if  \\  is 
stipulated  that  the  received  code  combinations  ('1  and  id  decoded  as  '  ■  ’ . 

At  the  same -time  a  code  consisting  of  the  combinations  11 1  and  Id  up  not 
afford  the  possibility  of  correcting  the  error,  but  cniv  of  detecting  it, 
although  both  of  these  codes  are  character i ced  by  the  same  Hamming  diManc-- 
of  2.  Let  us  note  that  in  a  symmetrical  channel  Loth  of  these  codes  per 
mit  only  detection  of  a  single  error. 

Of  considerably  more  practical  interest  are  nonconstant  channels  or 
channels  with  memory.  Included  in  them  are  most  channels  which  are  found 
in  communications  equipment.  Symmetrical  channels  with  memorv  differ  '"mm 
symmetrical  constant  channels  in  that  the  distribution  of  t ’ ■ » ■  number  of 
errors  over  the  length  of  a  certain  block  of  symbols  with  any  length  n  does 
not  always  follow  a  binomial  distribution.  If  in  a  constant  <.  Lionel  the 
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''here  in-  -c't'ril  rr  isow  for  the  deviation  of  p  r  ro  r  il  i  st  r  i  'nit  i  wi 
:  iv  r.  tin1  1  itioni  ; !  in  act  nil  charp'e  1  <  .  1  hns ,  ,i  channel  with  nemo  rv  prove* 

to  b,.  i  discrete  rr" rodent  .i t  i on  ot'  most  r.n!io  eh. nine  1  s  ,  usual  |v  because 
o'  thr  lading  w'mc1-  occur*  and  this  will  hr  onus  i  dered  in  Chapter  V, 

'nether  mason  r.i\  hr  ;i  t  mo*phe  r  i  r  .  i  ml  mutual  i  nterference  .  ‘'onirt  i  me  -  de¬ 
viation  from  a  ,'inon',.i!  il  i  st  ri  hut  i  on  i  s  raustul  bv  pocu  I  i  a  r  i  t  i  r  s  in  the 
methods  used  for  tv  du  1  at  i on  and  demodulation.  In  multiplexed  cable  com- 
rmrie.it  ion  lines  the  presence  of  commutation  interference,  which  occurs 
when  switch  ini’,  sepurn'o  elements  of  the  channel  and ,  in  essence,  tempo- 
rarilv  putt  ini’  the  channel  out  of  order,  is  usually  considered  to  he  the 
•■tuse  of  "remote." 

inlying  channels  with  merorv,  developing  correct  i  nc  codes  for  them, 
ml  •'viluatinr  their  effectiveness  is  made  difficult  bv  the  fact  that  to 
describe  such  a  channel  it  is  insufficient  to  know  one  parameter  (such  as 
the  probability  of  error  in  a  constant  symmetrical  channel'),  for  this  pur¬ 
pose  it  is  necess  iry  to  be  able  to  define  the  probabilities  of  anv  combi¬ 
nations  of  errors  within  the  limits  of  a  bloc!  of  any  lenrtli  n.  1  or  the 
purpose  o'-  ehfaininc  such  data,  resort  is  had  to  experiment;!  i  research 
into  virions  actual  channels,  However,  r.enern  1  i  cat  i  on  of  the  experimental 
results  obtained  is  made  difficult  by  the  fact  that  it  is  not  always 
possible  to  select  a  convenient  analytical  represent  .it  ion  and,  furthermore, 
different  channels  behave  differently.  Therefore,  researchers  are  twine 
to  construct  mathematical  models  of  a  discrete  channel  with  memory  which 
will  be  determined  bv  only  a  small  number  of  parameters,  an  approximate 
selection  of  which  would  at  least  permit,  in  general  terms,  describing  the 
behavior  o*'  actual  channels. 

l\e  will  tale  note  first  of  all  of  the  principal  peculiarities  in 
accordance  with  which  it  is  possible  to  classify  channels  with  memory.  Most 
channels  encountered  in  practice  satisfy  the  condition 


pU-ir'i )  ■/>  (  d  .  f> ^  1 

Th i s  means  that,  in  comparison  with  a  constant  channel,  in  such  a  channel 
errors  have  a  tendency  to  group.  Kith  an  increase  in  r,  inequality 
usually  approaches  an  equality.  Such  channels  will  he  called  channels  with 
error  grouping. 

In  most  channels  with  error  group ine  pfi  +  r  1  i  1  (m  -  11/m  and, 
specifically,  in  a  binary  channel  pfi  +  rid  •  1/.?.  Such  channels  can  he 
called  normal  channels  with  error  grouping  in  distinction  from  anomolous 
channels  in  which  pfi  +  r'i)  can  exceed  fm  -  ld/m. 
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i .r,oi 


are  oncount  orod  much  more  i  n frouncn r  1  .  \n  example  i  s  provided  In-  a 
channel  n  wh  i  oil  impulse  i  liter  feronco  is  the  cruise  o‘"  error  i  r  e;  ie!i  impulse 
destroys  enlv  one  svrhol  ami  the  source  of  i  nterl'erence  has  the  property 
tliat  the  probability  of  occurrence  of  the  I'oliou'inr  impulse  i  timed  i  at  r  1  v 
fellowim1  a  preceding  one  is  vorv  snail  and  increases  with  rin«'. 

I’hore  also  mav  be  channels  with  memorv  for  which  with  some  values  of 
r  holds  and  for  other  values  (J.Tdh  holds.  Thus,  if  I’.a^l  is 

ret  wit1,  odd  r  and  (J.ofh  with  even  r,  there  is  a  tetidnicv  ‘oward  dnuMinr 
el  errors  in  t  lie  channel.  \n  example  of  such  a  channel  will  he  presented 
later  on. 


MI  l  nown  :  cithomaf  i  ca  I  models  of  channels  with  memorv  at"  const  ructeu 
almost  exc 1  us i ve ! v  for  the  description  of  normal  channels  with  error  croup  i  nt' . 
\  Markov  model  is  .  lie  simplest  model  of  a  channel  with  memo)-'  i  n  that  it 
represents  sequence  s  of  errors  in  the  form  of  a  simple  Marloy  chain  l"1’!. 

In  this  case  the  poob.abj  |  i  tv  that  i  riven  svmbol  will  fo  received  i  ncona-ct  1  v 
is  eaua 1  to  a  certain  mavnitude  p  ,  if  the  precedi  nr  svrhol  was  received 

correctlv,  and  etiual  to  a  certain  other  marnitude  p,  i  •’  t  •>  u  nrecedinr.  sima! 
was  received  incorrectly. 


When  r,  •  p  a  Marloy  mode!  is  a  normal 

and  wM-p  p,  p  it  reprosenfs  •>  chanm  1  with 

conditional  (averapel  prooah  i  1  i  t  y  of  error  p 
t  he  eaua t i or 


channel  with  error  r roup i nr 
d  i  spersod  errors  ,  r,’o  ur  ■ 
in  such  a  ch.annc!  must  satisfy 


p  PV:  Ml  /■!/■:. 


whence 


P 


t  ;  ,  ml  ’ 


kith  such  a  model  it  is  exceed  i  nr.  I "  simple  to  calculate  the  ”rol'a'- :  !  i  t  v  of 
anv  combination  of  rrers  and  easilv  evaluate  the  effect  i  \  eness  of  anv  cede, 
bn  fortunate  1  v ,  t'M  s  nod'*l  onlv  verv  reurlilv  reproduces  the  pr  "of  i  es  of 
actual  channels  with  error  rroupinr. .  Mion-foro,  it  is  not  used  at  the 
present  time. 


Attempts  to  describe  a  channel  In-  usinr  a  Markov  chain  "  a  hirhor 
order  ( i . e .  ,  to  consider  that  the  proba'olitv  of  incorrect  reception  of  a 
symbol  is  determined  unamb i cuous 1 v  In-  how  the  procedi  nr  1  svmhois  wen'  re¬ 
ceived)  have  not  mot  with  success  either.  kith  a  small  k  such  a  mode! 
arrees  with  (Experiments  v'rv  poorl\-  and  with  a  larr»'  '  it  is  i  ace'p-oni  opt 
for  purposes  of  ca 1 cu 1  at  i up . 


‘I  lie  f-ilbert  model  for  mure  exact  I  v,  the  I'r.h  i  1  ’  b-er  t  ' 
n s o <  1  somewhat  more  successful  1  v.  In  iccordance  with  this 
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may  le  in  two  itiics,  ^  and  S,,  In  state  ^  there  art1  im  orrm  s  am!  in 
state  S,  error"  occur  i  ndepcndont  1  v  with  a  probab  i  I  i  t  v  of'  n,.  The  pro¬ 
bability  ('  f  an  .  -  s  •  >.  i  ft  (in  transmission  of  the  next  svtnho!  i  from  ite  ^ 
to  state  S,  and  the  probab  i  1  i  tv  of  a  .-shift  from  f,  to  b  are  inown. 

Thus,  here,  r.ot  a  sequence  of  errors  hut  a  sequence  of  states  forms  a 
simple  'hirkov  chain. 

Tlie  nrt'hah i  1  i  t  i es  of  existence  of  a  channel  in  states  •■■  ,md 
can  easily  be  computed  and  are  ••anal  to 


and  the  unconditional  probability  of  error  is 


P 


Most  frequently  in  us  ini’  a  filbert  model  for  a  I  inarv  channel 
p,  -  I'd  is  assumed.  In  other  words,  state  S.,  is  considered  as  a  complete 

break  in  communication  while  in  state  b (  then'  is  no  noise  in  the  charnel. 

This  agrees  rather  well  with  idem  al'out  a  channel  in  which  onlv  commut at i on 
interference  is  found. 


The  Kennet-f'roel  i  ch  mode!  is  more  general  but  less  convenient  in 
making  calcu'vions  In  accordance  with  this  model  errors  occur  in 

tlie  form  of  more  f  "  less  long- last  im>  surees  or  packets.  bv  nac! "*  is 
understood  a  sentience  or  signals  in  which  the  first  ana!  last  are  received 
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■\  Bonnet -I'rool  i  ch  model  is  more  flexible  than  a  filbert  mode' 1  s  i  nee  it 
permits  a  very  wide  selection  of  function  pil  l  on  which  on  1  v  the  usual  con¬ 
dition  of  standard  i  r.nt  i  on  is  imnosed  since  in  a  filbert  model  the  distri¬ 
bution  of  probabilities  of  the  duration  of  state  S.,  is  a  I  wavs  expressed  ?>v 

the  formula  p(l._,'l  =  •  ( 1  -  ^ ■  ',  i.e.,  the  magnitude  or  is  uniquely  deter¬ 

mined.  N'everthe  less ,  for  mam'  experimental  research  channels  it  Is  not 
possible  to  select  the  parameters  of  a  Bonnet -f roe ! i ch  model  satisfactorily. 
I  h  i  s  s  especially  true  of  a  dilhert  model.  In  view  of  this,  0.  ’  .  I’opnv 
suggested  [2a]  a  more  complex  mode  1  of  i  discrete  channel  differinp  *’rom  a 
Bonnet -''roe  1  i  ch  model  in  that  "aclets  of  errors  are  cons  i  lered  *  e  he  not 
independent.  In  accordance  with,  this  model  a  channel  can  have  two  states 
in  the  first  of  which  errors  do  not  occur  and  in  the  second  of  whir1',  ••it1' 
i  certain  probabi 1  tv,  packets  of  errors  do  occur.  The  probabilities  1 
shift  from  one  state  to  the  other,  the  probability  of  occurrence  of  a  racier 
in  the  second  state,  the  probability  of  an  error  within  a  racier  luhlch  is 
usually  equal  to  0.S1,  and.  the  distribution  of  probabilities  of  racket 
length  are  'the  parameters.  In  most  cases  it  is  possible  to  describe  actual 
chmnels  sufficiently  well  with  these  parameters. 

An  attempt  to  describe  a  binary  channel  with  error  grouping  using  onlv 
two  parameters,  i.e.,  the  probability  of  error  p  and  the  grouping  indicator 
■■  Iks  been  made  in  fo“l  .  Tor  -his  purpose  the  conditional  mathematical  ex¬ 
pectation  fpl  of  the  number  of  errors  in  a  Mock  of  length  n  on  condition 
r 

that  no  less  than  r  errors  have  occurred  is  considered.  The  magnitude  of 

vm'i  -  „  tnl'n  with  p  •'  1,  according  to  experiments  which  have  been  con¬ 

i' 

ducted,  is  approximated  sufficiently  well  for  se-eral  channels  by  rl-e  or¬ 


pin  cal  expressions 


',(«)  (')’  ’  With  -n  <iV 


v,  ("1  ' 


with  r  •  I . 
n 


where  •  is  a  parameter  which  depends  on  the  characteri st icr  of  the  channel. 

: or  constant  channels  i  =  0.  the  more  tin*  errors  are  grouped,  the  greater 
is  ..  When  -  1  the  errors  follow  in  a  continuous  stream.  I'e  will  note 
fhat  vfn'i  =  p  according  to  definition,  knowing  p  and  it  is  possible  to 
calculate  r!;c  probabilities  >f  a  different  number  of  errors  in  bloc's  of 
mv  length  without  giving  any  thought  to  the  mechanism  causing  the  croup I  nr . 

\  1  1  described  models  of  a  discrete  channel  with  memory  are  also  i  r. 
marge  measure  formal.  In  the  construction  of  thorn  no  attention  is  oa 1 d  to 
the  causes  of  error  grouping  and  a  pro’  ability  system  is  simple  selected 
which  must  describe  observed  tacts.  It  is  true  that  for  several  motels, 
for  example,  -'’O  Beir  ft -r  roe  !  i  ch  ,  a  "physical  '  mso"  is  mentioned  to  show 
that  only  commutation  interference  or  surre.  of  impulse  i  nt  er  Terence  , 
occurring  independently  tin  tin  I'opov  model  dependent  1 vl  of  one  mother 
and  more  or  less  destroy  inn  a  long  segment  of  a  signal,  is  the  source  of 
error.  But  these  models  are  used,  amt  rather  successful lv,  also  for 
channels  in  which  it  is  known  that  other  types  of  interference  exist  [-14  i  . 


lately  attention  has  been  devoted  to  rlio  construction  of  tihvsic.il 
models  in  distinction  from  formal  matheinrit  i  ca  1  models  of  discrete  channels. 
In  these  models  a  discrete  channel  is  viewed  as  ,•  reflection  of  a  continuous 
channel  and  the  distribution  of  errors  is  deduced  from  the  probability 
properties  of  tee  signal  and  the  interference  in  a  continuous  channel,  tor 
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chapters. 
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r\e  no  pun'ose  t  ,-*.  tee  code  lesig 


for  a  constant  symmetrical  channel  with  error  "t  ob.d- i  1  i >*  c.ria  t  '  "*e 
average  error  nrobd’iiitv  in  i  channel  with  memory 


See  1-Vmarl  d  to  f’hapter  M  . 
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In  order  to  provide  h  i  c1,  r-MTt  ion  fide!  i  t  v  in  t u  i  -  c  mo  wo  rus'  omrlov 
a  code'  which  cor  roots  erro*-  *  •  i .  1  *  •  -  two  dibits  in  lmn’t1  w’-en  comrilini’ 
rhe  svmho 1  sequence  a  fd^’1  . 

To  illustrate  a  channel  wh  i  c1’  is  nor  svr.rot  ri  ca  1  i  t  <  v'-mot  r  i  cm  !  on 
t  !u’  average  let  us  cite  a  discrete  rer  resent  at  i  on  of  an  acua!  channel  with 
frequency  modulation  (VhT)  an. I  n  u  row-ham!  interference  v'mrh  rrv  enter 
the  compression  channel,  the  release  channel,  >r  not  enter  the  eassiaand  of 
fie  receivini:  device  at  all,  i  s  channel  hi<  three  Mates.  In  state  ^ 

the  chan.ne!  i-  symmetiveal  md  the  ••rror  >"■  a,  ,i  •  1  j  *  N  p  •  1.  !  v  state  ^  , 

t  he  nrnhihilitv  n;o  )■  that  svmho I  ”o"  •...  i  |  !  >>.  •  received  fo-  •  >-ai'sni  tied 

scrim!  "1”  is  net;  I  i  u  i  h  I  v  sn.a  I  1  ,  'nit  nrohaH  !  i>  v  nil  !i  ,  <  reeei\  i  m*  "I" 

when  "l!"  was  transmitted  i  s  "  ,  p  In  s»mt"  mi  fh.  cm  train-,  proha- 

hilitv  p!l  I')  mav  he  d  i  spec  a  r  led  -ind  pro'-a'  i  I  i  t  v  nl  o  1 1  ■  n,.  It  t  s  appa¬ 
rent  that  the  receired  code  sentience:  it-  such,  a  channel  will  contain  hunch, es 
of  one-side<i  errors,  either  replacements  ,>f  tores  hv  ones  er  of  ones  hv  roros , 
file  rrohahility  that  in  a  sir.i’le  code  eomhi  na  t  i  on  a  m-pUp]  ",v‘  will  he  re¬ 
ceived  as  "I"  and  a  symbol  "I"  as  "O”  t  the  tvpe  of  error  that  telegraphers 
cal!  "shift  errors"!  is  verv  small.  In  tae"  .  in  state  f  the  nrohah  i  1  i  t  v  of 

two  errors  in  a  code  comh I  nation  which  is  not  vrrv  lone  u  o  m-r  1 1  lv  small 

since  ;•  I,  wliile  in  states  ,  and  shif*  errers  are  pr.i  ‘  ;  c  a  I  1  v  imt'o  s  jMo. 
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Here  the  first  term  indicates  the  probability  that  all  symbols  are 
received  correct lv  and  the  second  term  the  probability  that  one  term  out 
of  seven  is  distorted.  The  equivalent  probability  of  correct  reception  is 
equal  to 

qc  (I  -07'  |d  /'•’  I  7/’d  /'T \'n  . 

Mien  p  <  1  this  expression  can  be  written  approximately,  ignoring  high 
powers  of  n  as  follows: 

q  (1  ip  1-21  r  ••••!  7r  :  '  ’ 

ii  i 

whence  the  equivalent  probability  of  error  is  equal  to 

n  .V.'V 

This  expression  can  be  obtained  more  simple  if  it  is  considered  that 
when  pr  «$  1  t he  probability  that  three  or  more  symbol*  in  a  combination  will 
be  distorted  in  a  symmetrical  channel  is  much  less  than  the  probability  of 
incorrect  reception  of  two  sx-mhnls.  'borofore,  the  probability  of  incorrec* 
decoding  of  a  code  combination  in  code  I",  11  in  the  first  approx i mat i on 
is  equal  to  the  probability  of  incorrect  report  ion  of  a>\  t\>o  symbol*  out  o*‘ 
seven : 

«  r  r?;  /a*  ( 1  -p)''  :i/’’ 

whence,  in  light  of  I'.bM  IJd'H  immediately  ‘'oil  a, 

f.enerally  sneaking,  if  a  binary  lorrecting  code  is  dense ]\  "ic'ed, 
reasoning  similarly,  we  max-  show  that  ‘when  pr  •<  1 


'or  other  than  binary  codes  which  correct  errors  ir  s\—Wols  M  'si'-le 
by  r  and  not  correcting  errors  divisible  by  ,i  greater  number,  the  a»-orov  <  mat  e 
relationship  shown  in  k’.-ni  also  holds  in  a  symmetrical  oh>nno].  It 
should  only  be  remembered  that  by  j  is  understood  the  .amour t  o*'  information 
in  a  code  combination  expressed  in  bits.  Ixpression  is  a  •\articu)ir 

case  of  when  r  *  nt  since  with  any  n 

1  ~  ' 

«  «  i 

If  a  systematic  code  brjng  used  provide-;  *'or  the  possjWjijrx  of  cor¬ 
recting  an  error  dirisiMt  bv  r  in  all  cases  and  alse  in  sexetal  rises  of 
.an  error  divisible  bv  a  higher  number,  the  probabjlit''  of  incorrect  decoding 
of  ,a  code  combination  <  when  n  *<  1  i  s  approx  j  mat  e !  v  equal  te  the  "robabilitv 
that  there  will  bp  incorrect  reception  ef  t>r  r  *  1-th  ur'-ol  in  one  o*-  Tvr 
unoorroctod  corbj nations 
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r  ♦  1  ,  whence 

r  '  <rl  ’  .>.7 1 

,;rom  the  i'xt'ri";sioin  obtained  if  s  a'’t'arenT  fli.it  t*'e 
correct  i  m;  codes  is  greater  the  !e*-s  is  the  nrol  ah  i  I  i  t  v  o*  error  e  in  .1 
s  t  at  i  onarv  symmot  r  i  on  1  channel.  ’.or  ovir"lo,  when  n  ''.l,  the  rum  \  « 1 « ■  n  * 
prohabi  !  i  t  v  of'  error  tor  coile  ,  1',  according  To  1  '.«■*'  t  .  i<  run  1!  approx  1 

natelv  to  O.’V',  i.e.,  onH  h .1 1  *’  that  in  t*'e  ease  of  rrn.ir'  codier,  wh:  e 

with  p  -  P1  the  equivalent  proh.»hi!itv  o*'  error  i  c  on  the  order  •!" 

i.e.,  in  this  case  the  .ncrease  in  *'idolit  is  vor\  crest. 


It  sumnirc  up  results,  uc  rr,i\  note  t'\>t  *'or  an  of- 1  •  a*  1  \  e  cope  ir 1  sop 
of'  codes  (or  connin'  i  cat  i  on  svstensl  we  rav  use  eiihrj  the  !  i*i  "  o- 

uncorrecte  1  *rror  or  the  equivalent  pro*'  i*m  ’  1  •  \  o*  error.  "'<•  •  rs'  • 

these  measures  is  suitable  tor  cmnin  i  cat  ion  ivutr"*  *  r  in  sr  1 1 1  1  in’  re".iiv<, 

the  value  of  which  is  not  lost  when  there  is  t  snail  nunher  o*  erjor«  in.1 

decreases  only  nonot on i ca II v  ,  1*'e  second  treasure  is  conventent  i  •*•'<.■ 

cases  when  everv  finished  ne«<.iiT  rust  *>o  rrceo  ed  without  erro-,  i.e,,  w'o 
even  a  single  error  ruins  it  corrletelv. 
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Hu-  number  of’  letters  in  the  alphabet  of  -ost  languages  'on*-  n  :  t  xceed 
thirty-two.  Therefore,  any  telegram  written  with  letters  ran  '  e  miKrirfoi! 

with  ;i  five-digit  binarv  code  (since  .?  -  .VI.  In  addition  to  I «- t  t »-  r  *4 . 

however,  Telegrams  <on,rt  iro«;  contain  minerals  ami  punct  unt  i  on  r.arl  < ,  <0  rl,i* 
the  Totil  number  of  i  Kn  ^  in  the  alphabet  of  the  to !  e graph  apparatus  1  s  o'"- 
liilcrsM'  more  than  thirtv-two.  Therefore  „  primary  eticodirp  in  a  uniform 
binarv  code  would  minim  six  svnbols  in  the*  code  cofi'm  nnt  1  on . 

The  average  number  of  svnbols  per  sign  1  <  suh«t  ant  i  .1 !  !  v  reduced  '>\ 
using  a  system.  of  registers.  in  the  simplest  case  a  T  o  1  egr  i"1’  ai'”a  ra  :  us  •'  i«. 
two  regi  sters ,  i  .  0  .  ,  two  possible  <t  itr1: .  In  the  f  ir<:t  state  <  let  tor  r<  •  0  i  ^  - 
tor)  five-digit  code  eonhin.it  ion<  eorre^pord  i  n.g  to  the  usual  1  o?  t  >•  rs  of  -hr 
a  Iphahet  ant!  the  space  between  words  are  sent  and  received.  In  t'-e  second 
<tnte  f  mineral  register'1  the  same  code  corh  i  rat  i  on«  correspond  to  minerals 
ind  punctuation  marls.  Two  code  conhi  nations  are  use1  to  transfer  ?*’r  re¬ 
ceiving  apparatus  from  one  register  to  t'>e  ether. 

It  is  easy  to  ascertain  that  if  .1!!  ’he  sipas  VmTud'rg  miner  Is  1 
"unctuation  rarlsi  appeared  in  ’elegrans  with  the  s  me  pro*'  d-i  I  •  t\ 
register  svsten  would  not  *m*  econonicaj,  'mit  ,  op  the  care  nr*  .  would  p ;  •  e  1 
certain  loss  in  corn ri son  with  use  of  1  primarv  sjx-!igi*  code.  In  f 1, *  , 

1?  the  prohahilitv  that  the  next  transr.itted  sign  'r  I  onps  to  *>',•.  Ir’fo' 
register  is  IT,  then  the  proh  d-  1 1 i t  v  th  it  e»  ic’ I v  1  si gns  in  <uc ;e< si  p 
will  belong  to  the  letter  register,  after  whir*  ’here  will  ir  1 

t  .  t  .  1 

belonging  to  the  numeral  register,  i  s  1  )  ’  )  *  -  '  .  si-.- 

is  1  !  s  '  *  rue  of  the  •  -  rob  d'  V  )  f  v  t  *'  1  *  l  S  1  gr  s  ;  I  r  M>  w  •  1  I  *•,-  I  -  •  *  •  e 

•Mirer  1 1  register. 

I*’ e  ~ather.it  i  c  1 1  e xpec  t  1  *  1  n  of  V  s  j  gp «.  o—  t  n c  •'  1  r . n,  '  «•  •  ■> re  , 
change  of  register  p 

1 

•  V  •■  j 

Therefore  the  sign  for  ch  inge  o’"  regi  step  will  »*e ,  or.  •  ’•>  <•  a\  « .*••  , 
transr.itte!  after  everv  two  information  letters.  ’  r  ins-  s  s  1  op  ‘  *  og"< 
reuuires  an  average  ot  r.\  ."*  —ore  <  \— >-  o  ]  s  for  register  cwmge  ro«nhi"it:  ns 
besides  the  *  h  svtI'oI  s  for  ’he  cole  combinations  -he— selves.  ’ '•«<  i\e-ige 

nunhpr  of  s  vti'-o  3  s  per  sign  will  br  1  j  .  1  T1  *  1  .  «• .  .  -ore  v.  •  •  '• 

pri-arv  encoding  in  a  six-digit  cole. 

In  realitv,  numerals  and  punctuation  r.ar' s  ogrvir  corsideri'Tv  ]m 
often  in  telegram  texts  than  In  letters.  1  ur?  her—,  ore ,  nurerals  o,'ter  r'!1>w 
one  after  the  o*her.  's  a  result  average  le-r’h  of  -he  sequence  er 

signs  belonging  To  one  register  is  substantially  —ore  than  • we  in  1  ordi-arTv 

The  widely  used  Soviet  telegraph  apparatus  ^  - 1  v  ,(s^s  tKree  regi sters- - 
Tussian  letter’,  latin  letters  an1  minerals  ti-dudirg  minrtua  ’  "  er  ~arl  < 


- 1  Of  - 


reaches  'Si'Vt'r.il  tons,  IU-  virtue  of  this  the  averape  number  of  svirbp !  s 
per  sipn  proves  to  be  but  little  norc  than  t’ivr,  i.e.,  usino  reristers 
vields  coni  i  itcr.iM e  savinps. 

I  ft  us  note  that  the  enp  1  ovnent  of  rep i  st i*rv  .  I  i  1  *.*  other  methods 
of-  reducing  redundancy,  de  c  reaves  res  i  stanc  e  to  intcrf’crriu’c.  !his  ^'ok< 
up  in  the  fact  that  incorrect  reception  of  a  reg  i  st  er- sh  i  ft  combination  o 
a  sign,  or  vice  versa,  cause*;  error*;  in  a  series  of  following  signs  uni 
even  changes  the  number  of  signs  received.  Therefore,  register  coding  is 
general  lv  not  used  in  modern  systems  of  discre’e  if*  'rmatinp  1 1 ansmi ss  i  on 
' f  khid’  •*  i  gh  reliability  is  ienanded. 

■I,  I  see  Sections  ' .  ~  un!  J.'O.  "t  sjrelest  method  corrective  codin' 
is  repetition  of  information  syml.ols.  If  ever'  i-dip.it  comb  i  nat  i  on  of  a 
primur'  code  is  repeated  d  tires  a  correcting  code  with  n  -  di  and  wi*b  i 
Hamming  distance  of  d  will  I'e  obtained.  It  is  interestin’  to  note  that 
this  code  will  be  systematic  and  cyclical.  Vccording  to  ti'e  general  rule 
it  will  permit  detect inp  errors  if  their  number  does  not  exceed  d  -  !  or 
correcting  errors  if  thev  are  divisible  (v,  i*b  .m  mill  I  't  number  rot 
preater  than  l-’(d  -  P.  Correction  of  errors  is  >'ere  per*'ormei!  bv  •  »u. 
rule  of  the  naioritv  which  in  a  symmetrical  constant  channel  corresponds 
to  the  criterion  ot'  raxir.il  livelihood.  the  r<  dundancv  f  sue1*  i  code 
r  !  -  1  d  is  much  preater  than  in  -ore  complex  drs  wit1,  •  .ire 

hamming  distance.  "■ :  s  short  con  nr  i<  made  up  tor  Kv  *.irrl>cit\  of’  Vcodi’ 
onlv  m  rare  case* 

1”  i  rarticulir  case  if  a  combination  o*’  a  priam  code  is  Trans- 
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or  t 1  s  •nirr 

s  e  ’  s 

Sllf  f 

l v  i ent 

i n  repet i ? i or  'f  a  v 

!e  cor'-  i  not  i  n  ,  i  •'  tK 

e  i  n :  •  t  I  c  or*  i  n.i  *  :  on 

h  i  s 

m  odd 

we:  ph t  .  to  invert  t‘* 

r  !  *• 

'  i  .  e .  .  t  *  re 

P  1  ac e  i  "  '■ 

by  >  "  1  " 

.  nd 

vice  \  e 

rsa  .  l  enpf  h  o? 

i 

:  np  com*'  i  r.T  i 

or  ~ust  1 y  n 

0  *  !  i'  <;  <; 

t  han 

*  mr . 

’’ecedi  np  is  lone  in 

.1  i  •  • 

he  same  wav  a 

s  >.  t  •  w  r  d  i  r 

\r\  rrt'c- 

If  comb  i  nat  i  i*ns  i  f  i  redundant  code  with  a  mif’i~al  farming  distance  d 
are  repeated  several  tre',  a  code  with  ^  =  l^d,,  where  d,  is  t’-r  nur* er 
of  repetitions,  is  obtained.  Thus,  'v  r«r>catinp  cor*- *  rat  ions  with  • 


twice,  we  obtain  .  code  with  d  -  J  and  wr  r **  in  th.*  -o  a‘'!e  to  correc 

-in 

•ingle  ettors  and  to  detect  double  errors. 


"he  essence  of  such  methods  of  coding  docs  no?  chance  i  r  *hr  length 
f  the  repeated  b  Joe1  is  ircre.isc1  to  the  duration  of  ir  entire  finished 


message.  In  t1,  -•  1 rocess  flip  pft'ppr  i  vein  ss  of  the  code  may  he  increased 
thanks  to  prroi  ..  correlation.  Tl’prpforp,  it  i  s  impossible,  an  some  author 
Jo,  *o  contrast  systems  with  rppotition  with  systems  with  a  correcting  code 
The  rpppt  i  t  "  ct  a  dpsci.cc  is  also  a  correcting  code  wh  i  c1'  is  little  of  fee 
five  Kut,  on  Me  other  hand,  ensile  rcaliraMc. 

(bpt>  Sections  2."  and  .1 .  d  .  In  seeding  of  the  limited  possibilities 
of'  gun  rant  ee  i  ng  a  high  decree  of  fidelity  in  noise  channels  M-  using  cor¬ 
recting  coties  with  a  long  block  length  n,  we  had  in  mind,  firstly,  thp 
difficulties  inherent  in  encoding  and  decoding.  In  some  cases,  however, 
obstacles  of  another  nature  arise  which  limit  the  maenitude  of  n  and  rhi-re' 
the  achievable  fidelity. 

Mien  n  ••  !  a  significant  amount  of  time  elapses  '','tKeen  the  start  and 
end  of  reception  of  a  Mod.  But  prior  to  the  termination  of  reception  of 
a  block  it  is  impermissible  to  proceed  to  the  decoding  or  i  * .  ''bus,  h,>twco 
the  start  of  reception  of  a  messare  and  issuance  of  it  to  the  recipient 
there  is  an  inevitable  tine  delnv  which  is  proportional  to  n.  If  messicrs 
ire  created  M-  a  source  with  a  fixed  rate,  almost  the  s.i^e  de!a\'  occurs 
during  coding  inasmuch  a°  a  code  con1'  i  nat  i  <'t'  nav  be  formed  on  I  v  after  Me 
source  has  emitted,  a  sufficient  volume  of  "essape.  In  some  svstem*'  i  1  ”■ 
de  lav  is  impermissible  inasi-uch  »<  the  transmitted  information  ran  i  1 1  v  !o<. 
i  t  s  >•  | ;  up  . 

,, ,  i  s,>e  Sect  i  on  d  .  1  rr,;i  l  a  ' .  !  •  s  accur  it  t  if  • 1  <■  1 1  "r  |  s  •  1 1  e 

t  now”  t  '  boM  correspondent  s .  !  •■  een<  ra  1  c  i  for  a  roiiur  'or  d 

t  he  rite  'f  i  r  rm  1 1  i  ”i  ♦  r  i"s~;  <>•  t  <  *n  I*  -.r.  'e  f  >ip*  i  f  rem  "  >*>  !  • 

*  ;  on  r,  i  n  format  i  -'p"  t'rmila  'eriej  by  \.  \,  ‘  ,ip  u'«'r<".  f  V- ' 

/iii'  *• )  /  ■  v  1  'J  . 

•  /  M  ■-)  •  'I  IV.  V  % 

where  /  1 1  'i  •  •.  r  i*«-  •'  *  r  irs-i  ■  i  i-*>  >•’  •'  v~  •  i  op  g  i  • 

e  pie'  •  Pie",-.  ’  •  *  I . .  ’  <  •  ♦  e 
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Since  [  1  '  (S  ,  y  '  y  ' '  1  1  0  (because  rlie  .ncni'o  rate  of  i  n  Co  rm.it  i  on 

trn  smission  cannot  he  nopat  i  vol  ,  we  will  obtain 

r  (</  .  '■  i  [/•(■■  . 

On  the  other  hanil,  in  formation  theory  it  i  s  proved  ‘hat 


|  /  l  V  .  I  j  .  /  (  V  M 

where  II' (SI  is  the  entropy  of  tie  channel  state,  whence  it  follows  that 

/  I  .  1/1,1/  IK  .  '-.'I,  ,  a  lsl 

Combining  these  inennn 1 i t  i os  we  find 

|/  i  >  .  ..  'i,v  li  Oi  /  (C.  i, i  (/(/..  ,  ( 2 , ' 

let  p|v(  be  the  distribution  of  sv-ho!  nrob.ah  j  t  j  ?  i  es  max  i  tri  r  i  np 
!"|v',vl.  Then  the  earnin'  canacitv  of  a  channel  with  meron  is 


t  ni  o  /  (  .  i/I  lli'.  ,/  (  ■  1 1 


.  ~h  ' 


and  since  i  no«j  ua  1  i  t  >  ’'olds  with  «n.  'istri'-urior  if  •-  \  1  ,  then 

/  •  ;/  ju  u  s  /  o/i,;  ;/  i  -  ,  -  --  i 

.  r  i 

'hit  the  maximum  of  the  on-rape  v  alue  of  sever  il  rarnitnles  'o<'s  not  excei'd 
the  avorape  value  'f  t’'e  rixirips,  whence 
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where  e  .  is  the  earn-!  nr  •  ip  ici  f  \  r  ape  1  "  er  s*  i* . 
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CONSTANT- PAP AMFTFP  CHANNFL  WITH  ADD  I T | wp 

fluctuation  intfrffrfncf 

3.1.  Statement  of  the  Problem 

This  chapter  examines  the  transmission  of  discrete  messages  with 
element -by -element  reception  in  a  const  ant -parainet er  channel.  Inch  symbol 
of  tin.  code  sequence  is  represented  as  some  segment  felementl  of  a  signal 
sent  from  the  transmitting  to  the  receiving  device.  The  receiving  de¬ 
vice  determines  from  the  received  signal  plus  noise  and  the  chosen  statis¬ 
tical  criterion  what  symbol  was  transmitted  and  then  determines  the  trans¬ 
mitted  message  from  the  restored  sequence  of  the  code  symbols. 

In  an  analysis  of  the  transmission  and  reception  of  signals  hearini’ 
discrete  information  discloses  the  following  main  questions  arise: 

a)  what  should  he  the  design  of  the  first  decision  svstem  which  de¬ 
termines  from  the  received  signal  element  what  svmhol  was  transmitted; 

h)  what  is  the  maximum  probability  of  correct  element  reception  with 
given  parameters  of  the  signal  and  interference  and  with  the  use  of  an 
optimum  decision  system; 

c)  how  does  this  probability  change  if  the  actual  system  of  the  receiving 
device  deviates  from  the  optimum  decision  svstem; 

ill  what  signal  shape  should  be  chosen  in  order  to  produce  the  greatest 
fidelity  when  different  restrictions  are  imposed  (e.g.,  given  signal 
strength,  etc.);  and 

e)  what  is  the  carrying  capacity  of  the  channel  under  examination  with 
different  restrictions  imposed  on  the  signal. 

These  questions  have,  to  a  significant  degree,  been  answered  for  a 
channel  with  additive  fluctuation  interference  bv  v.  \.  K'otel'niVov  Til, 

('.  1  .  Sha.inon  [2],  and  other  authors. 

3.2.  Pepresentat ion  of  Siqnal  and  Interference  Usinq  Fxpansion  Into  a 
Four i er  Series 

I.et  each  of  m  symbols  of  a  code  be  transmitted  as  some  element  o'' 

signal  c.frl  (i  =  1 . ml  given  over  time  interval  T  .  Thus,  the  signal 

k  i  '  e 


-  1 II- 


represents  a  sequence  of  elements  of  equal  length.  Ke  will  studv  the 
conditions  of  reception  (discrimination!  of  a  single  element  of  the 
signal,  \  signal  plus  additive  arrives  at  the  input  of  the  receiving 
device,  the  signal  being  expressed  by: 

c'  (/)  «i’,  it  /,.)  |  n\n  p„  l-  l„  I  /,  i.  ( 3  _  i  ■) 

where  is  the  channel  transmission  factor;  t  ,  the  passage  time  of  the 

P 

signal  in  the  channel;  n(f),  the  additive  interference;  and  tn,  the  instant 
of  start  of  transmission. 


In  this  chapter  we  will  regard  •„  and  t  as  constants.  In  addition,  it 

is  assumed  that  the  value  of  is  known  when  the  signal  is  received,1 
just  as  is  the  shape  itself  of  each  element  of  signal  z  ft!  .  Moreover, 

the  instant  t  -t  of  the  start  of  reception  of  a  given  element  is  known, 

Op 

i.e.,  the  transmission  system  is  considered  to  lie  synchronous.  Taking 
this  moment  ns  the  beginning  of  the  time  count,  we  mav  write  the  expres¬ 
sion  for  the  received  signal  as 


:’(/)  n  -  /if/)  (0 •  t  :T  ). 


f  ,i.  la! 


The  first  decision  system  must  determine  the  index  of  the  transmitted 
element  of  z.(t!,  i.e.,  analysis  of  the  received  signal  -'ft!  must  be  used 

to  decide  what  code  svmhol  v.  was  transmitted. 

'  i 

l.et  us  represent  the  functions  - .  ft!  ,  n(t!  and  -  ’  ft!  in  the  interval 

0  •  t  •  T  as  a  Tourier  series: 

—  e 
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'it  will  be  shown  below  that 
removed . 

in  a  number 

of  cases 

In  some  cases,  as  will  In'  shown  below,  it  is  convenient  to  studv  the  signal 

in  the  interval  0  •  :  ■  T,  where  T  •  T  .  Here  information  is  lost  which  is 
—  e 

contained  in  the  discarded  portion  of  the  signal  element  in  interval 

T  ■  f  •  T  .  Rut  i f  T  -  T  <  T,  this  lost  information  has  little  effect  on 
—  e  e 

reception  fidelity.  At  the  same  time,  proper  selection  of  t  subst ant i a  1  I v 
simplifies  the  decision  system. 

.Sec  Remark  2  to  Chapter  111  for  the  meaning  of  the  expansion  of  a 
random  process  into  a  series. 
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.  v  f  t.SnirViicinT  ffi  ■  ■ 
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It  is  obvious  t  li.it 

li>.  %  I'. 

I'he  I'ourier  coefficients  \j  ,  1’^  contain  ;i  1  !  tbe  i  n format  •  or 

the  transmi  tt-kl  signal  that  there  is  in  ''•••  nueived  s  i  gr.i  !  ~  *  .  •  • 
z’(t1  may  be  uniquely  restored  from  ttese  coefi  c :  out  «  . 


In  the  vast  majoritv  of'  cases  signals  .  ( t  )  are  chosen  tb.,?  mile 

1 

a  finite  number  of  coefficients  a.,  and  b.,  lifer  from  zero.  I  f  r1  :<  .  or  - 

1  K  11 

clition  i  s  not  observed  a  value  T  •  '!  ^  nav  usual  lv  >e  selected  such  t1’  < 

when  the  signal  is  represented  as  a  I'ourier  series  in  the  internal  o  ■ 

f  _  T  (as  stated  in  the  footnote!  a  finite  and,  in  most  cases,  a  spall 

number  of  coefficients  a.,  and  h..  mav  bo  derived  which  are  different 

1  k  lb 

from  zero. 


let  kj.  and  k.,.  represent,  respect  i  ve !  v ,  tie  least  and  the  great  es* 

subscripts  of  the  I'ourier  coefficients  a .  ^  and  b  which  an  different  *'ror 

zero,  Then  k ^ . /T  and  k^./T  are  the  least  and  greatest  freuaencies  in  the 

I'ourier  series  expression  of  signal  z.(t'),  let’s  agree  to  cal!  the  mativ- 

tude  T  =  fk„.  -  k,.  +  1 1  /T  the  frequence  band  occupied  ’-v  <  1 1;:'.  :s  i  z.lti. 
Till  •  i 

If  In  kj  and  k,  are  understood,  respect  i  ve  I  v -,  the  least  and  the  greatest 

values  of  k  with  respect  to  the  whole  signal  set  used,  in  th*'  riven  conru 
ni cat  ions  system,  the  magnitude 


represents  the  frequency  band  occupied  by  the  system. 

Ohviouslv  i;.  •  I'.  U'e  will  call  dense  these  svstenis  for  which  I  .  -  T 

i  -  i 

for  all  i.  i.e.,  wlien  all  realizations  «.f  tin  signal  occupy  the  same  fre¬ 
quency  band. 

It  should  be  noted  that  the  magnitude  1  is  not  the  signal  spectrum 
width  in  the  ordinary  sense.  As  a  rule,  the  signal  has  a  continuous, 
not  a  discrete,  power  spectrum,  and  furthermore  it  is  unlimited.'  I'ho 


'Sec  Remark  1  to  Chapter  111. 
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for  white  noise  the  <r«r*v' t  r -i  I  Jcr'i?'  1  -  does  t  |n  defini*.  ion 

depend  on  frmpiencv. 

3.3.  ^ecision  Principle  and  decision  ^<,tcr 

let  .1  signal  plus  interference  r'lt'  enter  »he  recover  1  *i*'i  t*  .  !'<■  u  i  I 
studs  riie  case  where  * '  e  i  nt  cr  f'erence  i  >*  norm!  white  noise.  '’11  riM’r'  ii"1 

rfio  rran«ritted  «=  i  e  n  •*  *  : .  1  r 1  ii  -  1 . -  1  corres'-ond  i  nr  r  '  e\e-v  svnho! 

1 

ire  exact  I  v  inown,  11  well  1  s  t’m'  i  priori  pr<',M1'  1  )  i  T  1  e*  of  T  rat's-  i  s  s  1  o«  o*' 
each  symbol.-  According  to  the  i  - 1  c* .  *  1  n^ser’ er  criterion  the  first  decision 

•!hc  pro’sah i  I  i  t v  connection':  between  the  svnhols  in  1  coi'e  senuence  >re  not 
talen  into  cons  i  ilerat  i  on  here  since  we  are  ilea  line  with  elerent -*'v -e  lerent 
reception  in  which  the  first  decision  svster  determines  tlie  svrihnl  trans- 
nitted  with  respect  to  the  received  signal  element  without  con« i derat i on  o' 
the  values  of'  other  symbols. 
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sc”  iccor.iine  to  t  hr  idea!  observer  criterion.  ''.nee  the  donord  n.it  or 

1  ' 1  t  does  net  depend  nn  r  it  suffices  to  compare  the  rsii'r»’*r  :i  t  nr<  of 

is  express  ion  for  .ill  possible  sit»r;ils  r  ft'.  Conseunent  1  v ,  a  ileeision 
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stem  const  rueteil  in  accordance  with  the  ideal  o>'ser\er  criterion  and 
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i  M 


It  is  easy  to  ascertain  this  hv  substituting  the  values  of  r.'(tl  and  ;  (tl 

expressed  ns  series  (a. 21.  Taking  into  account  the  orthouona 1 i t v  o*'  the 
t r i ronomet r i c  functions 
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whence,  .iMit  simple  f  run*  f  nr.i  *  .  on«  ,  ‘'ollm,*.  »he  emu  i  \  i  teiK  e  <>*  i  ihm  »u  « ' 

1  .*  ,  d-H  Hfld  (  3  .  J  '.1  1  . 

!(u*  !  c- v  i  <  ion  principle  in  n-tcrn!  fair  i",d-.)i  w.m  f'ir*t  der  i  ved  1 

\  „  \.  1  of  e 1  '  n : '  'v  f ,  ] .  l?i  the  particular  v.i<e  where  the  a  ?  i  r  i  ■  ■  r  i  piu4 

I'.n*' i  !  i  t  i  >,•*;  a*'  the  c vrbp ! <  are  i dent  i  ca  1  ,  r  >>  this  *  rim* i r it*  adopt  •-  ' '  - 

V 

•*  j  p*'  1 1*  t  .'rm 

t  r 

7  |-l:  ,n  ,‘j  l  *'(.*)  (7>,:-\n 

0 

<;  i  gr  i  f  v  i  rg  that  the  decision  svstcm  must  select  the  expected  signal  ~  1  t  1 

which  has  the  least  near. -square  deviation  from  received  signal  r.'ftl.  In 
this  case  i  neoua 1 i t v  i  ~  .  7  “  •  i  ™1  adepts  the  fern 


V  |,  1, 
*  1 


M""|!  :  </;*  V\.»*|  V[«  U-IWI,,)*  i 
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(3.d3bl 


let  us  ol  serve  that  in  expressions  (.".deal  and  (3.d3M  it  is  in  fact 

sufficient  to  tnic  into  account  onlv  the  terns  for  which  a  .  or  h>  ,  are  not 

ri  ri 

identicallc  equal  to  zero  fat  all  values  of  rl  ,  because  the  remaining  terns 
are  identical  on  both  sides  of  the  inequalities.  In  other  words,  the  num¬ 
ber  of  coefficients  \  R  of  the  received  signal  which  are  significant 

when  making  a  decision  about  the  transmitted  svmhol  is  cuual  re  the  base  of 
the  system  (3.31. 

It  is  apparent  that  the  principle  expressed  bv  fo.dob'1  or  bv  (3.24a1, 
which  is  equivalent  to  it.  can  be  obtained  with  arbitrary  values  of  the 
a  priori  probabilities  of  the  symbols  if  the  criterion  of  maximal  likeli¬ 
hood  is  used  instead  of  the  criterion  of  the  ideal  observer.  We  will  draw 
attention  to  the  fact  that  this  principle,  in  distinction  from  (3.241,  does 
not  reouirc  knowledge  of  the  intensity  ob  the  interference  which  determines 
the  dispersion  v^.  In  this  lies  one  more  merit  or  the  criterion  of  maximal 
1  ike] i hood . 

figure  3.2  shows  the  functional  diagram  of  a  device  which  operates  in 
accordance  with  decision  principle  (3.241.  Received  signal  c'ftl  goes  to 
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pressed  In-  fo..\n. 


The  circuit  examined  is,  oi‘  course,  net  suited  ?<>  :i--ict’.*il  use.  !u 
part  i  cui  ;ir ,  it  is  very  difficult  to  sou. ire  accurate!*  with  a  r>'n  1  i  near 
circuit.  This  difficulty  nay,  however,  ’u-  ••  i  reinvent  ed  'n-  r  r-ins  f.  m  n  i  nr  flu 
reception  principle  in  expression  f".."’*l.i1  or  ‘‘tn'i  .  I'poping  r  '•  r-  naren- 
tiieses,  reducing,  and  introducing  the  .les  i  gnat  i  or 


rj  /’  V  utt  ■  /•  j  /',. 
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we  derive  the  equivalent  inequality 

A'.-  A'  /f 

when  all  r  ^ 


JIt  is  presumed  that  the  resistors  through  which  the  .  anacitors  d  i  sv''a  rge 
are  so  large  that  the  discharge  current  is  strictly  proportional  to  the 
voltage  at  the  output  of  the  non  1  in.  nr  circuit  i  independent 1  v  of  t'u'  s  j  ,-e 
of  charge  on  the  capacitor. 

■  In  the  following  material  decision  principles  and  I'nnct  i  ona  1  di agrams  will 
he  given  for  systems  with  equiprofaMe  sr-Unls.  They  also  meet  t'-o  criteri 
of  maximal  likelihood  in  the  ease  oi  a  r1'  i  '  >  rv  a  priori  prolwal'  i  !  i  t  v 


:  vm'> 


I  _'■!  - 


. - - - ..  .... 


Figure  7.2.  Dec.  is  inn  System  Ren  I  i .?  i  no 
the  Ideal  nhserver  Criterion  (Kotel1 
n  i  kov  '  s  f  r i t  er ionl . 


I'oro  P  is  the  average  power  of*  signal  :  at  t!ie  input  of  the  rc- 

r  ,  w!i  i  1  e 
pectod  signal 


eeiver,  while  \  is  the  scalar  product  of  received  signal  c'(t’)  and  ex- 
r 

:  rn. 

r 

The  t'unctii  vil  diagram  (figure  .".3),  designed  from  incuualitv  fa.  2"  1, 
contains  m  multipliers'  to  which  come  the  received  signal  t'ft")  and  the 
voltages  :  (tl  (r  =  l,...,m)  from  signal  simulators.  The  voltages  from 


the  output  of  each  multiplier  are  integrated  and  tV  result  of  integration 

is  fed  to  a  subtracting  device  in  which  magnitude  1  is  subtracted  from  it. 

r 


\t  instant  t  -  T  the  voltages  from  all  the  subtracting  devices  are  compared 

to  each  other  in  the  comparator,  which  emits  the  number  of  tbe  svmbol  for 

which  voltage  X..-P,  exceeds  the  other  potentials  \  -  P  'hereafter  the 

i.  r  r . 

potentials  in  file  integrators  are  cut  off  and  tbe  circuit  is  ro.ad.v  to  re¬ 
ceive  the  next  signal  element. 


The  decision  principle  and  its  functional  diagram  mav  >'o  greatlv  sim¬ 
plified  if  flic  signals  ;  (t  are  so  chosen  that  their  power  (or  average 

power") 'is  identical  (P  ,  =  P.  -  const").  Then  incuualitv  (3.2"")  fakes  on  this 
simple  form 


,V.  -A 


(3 . 2S1 


'.See  first  footnote  on  p.  143.  In  the  given  circuit  the  multiplier  is  often 
called  the  synchronous  detector. 
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when  all  r  /  anil  the  subtracting  devices  imlicatated  hv  the  broken  lines 
in  Figure  3.3  may  be  omitted.  But  the  simplification  which  can  be  obtained 
is  not  limited  to  this.  Inequality  f3.HR')  differs  from  f3.H"’l  in  that  it 
docs  not  depend  on  transmission  coefficient  u  and,  consequently,  when  the 
signals  are  of  equal  power,  it  does  not  require  a  priori  knowledge  of  the 
"scale"  of  the  expected  signals,  but  onlv  of  their  shape,  to  brine  about 
optimum  reception  in  accordance  with  the  ideal  observer  criterion.  The 
signals  generated  by  the  simulators  must  coincide  with  the  expected  signals 
;_lt1  in  shape  and,  of  course,  must  be  strietlv  synchronised.  \s  for  the 

"scale"  of  the  simulating  signals,  it  may  be  arbitrary  and  the  most  convenient 
for  practical  realisation,  as  long  as  it  is  the  same  in  all  simulators.  In 
fact,  when  we  increase  the  voltage  of  all  the  simulators  hv  a  factor  of  n 
we  increase  the  voltage  of  all  the  simulators  by  a  factor  of  n  we  increase 
X  and  X,  bv  the  same  number  of  times  and  hence  do  not  affect  the  observance 

of  i  nequa  1  i  tv  (.3. 2 S 1 


Fiqure  3-3-  Variation  of  Decision 
System  Realiz  nq  the  Ideal  Observer 
Cr i terion. 

As  will  he  apparent  from  the  following,  this  important  property  of 
systems  in  which  the  power  of  the  signal  element  does  not  depend  on  the 
transmitted  symbol  (feasibility  of  optimum  reception  without  a  priori 
knowledge  of  the  propagation  coefficient  or  even  of  the  power  of  the 
emitted  signal)  is  also  maintained  for  channels  with  variable  parameters. 
We  will  agree  to  call  such  systems  "active- interval  systems." 

The  circuits  examined  contain  elements  with  variable  parameters 
(short-circuited  capacitors).  They  may,  however,  be  converted  so  that 
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they  contain  only  elements  with  constant  parameters  and  at  the  same  time 
function  in  conformity  with  the  reception  principle  of  inequalitv  (3.2~) 
or  (3.28)  (for  active-pause  systems').  This  variant  differs  front  those 
examined  in  that  at  the  output  of  every  multiplier  is  connected  a  linear 
pulsed  filter  instead  of  an  i  ntegrnt  i  ng  capacitance.  This  filler's  pulse 
response  is 


<,(/)..  (  1  when  0  <  t  <  T. 

10  when  0  <  0  and  t  >  T.  to..'”" 

This  filter  is  physically  realizable.  The  volt  are  at  r)ie  filter's 
output  at  instant  t  =  tj  will,  according  to  Imhamel's  ttteorem  fe't  t>e 

“.»!!>  J  |U',(A)  C’(.V)p(/|  AI./.V 
/ 

I.  (t.pO'l 

•-  P  |  (.V)C'(.V),/.V. 

<.  T 

where  z'(t)  is  the  received  signal  and  r.  if)  is  the  voltage  of  the  r-th 

r 

local  oscillator  (signal  simulator). 

At  the  moment  an  element  is  finished  rite  voltage  at  filter  output 
represents  the  result  of  integration  during  t'>e  reception  time  of  that 
element.  At  this  instant  the  voltage  at  the  outputs  of  the  filters  (or  of 
the  subtracting  device  are  compared  to  each  other  and  act  on  the  record  ini' 
devi ce . 

It  must  he  remarked  that  with  respect  to  the  requirements  for  synch¬ 
ronization  this  variant  has  no  advantages  over  the  system  in  figure  3..". 
While  the  capac i tance- i ntegrat i ng  system  needs  to  cut  in  the  integrating 
circuits  at  certain  instants  the  system  with  optimum  filters  behind  the 
multipliers  needs  to  feed  voltage  at  certain  instants  to  the  recording 
device,  and  the  requirements  for  aceuraev  of  synchronization  are  identical 
in  both  cases.  The  optimum  filter  of  (3.29)  mav  in  principle  he  realized 
with  a  delay  line  figured  for  time  !',  e.g.,  as  shown  in  figure  3.-I. 


•pi!l 


T  delay 
line 


s 


0'iipm 


Fiqure  3.^.  Diaqram  of  Inteqratina 
F i 1  ter . 
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means  >il  it  a  sy^tcr;  tar  puttinp,  the  optiP'itm  ilrnsnin  principle  into  nrac 
t  i  co  anil  thus  for  providinp  the  proa  test  possible  p  rehab  i  I  i  i  v  of  correct 
s  i  ena  I  i  ilont  i  f  i  car  i  on . 
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fimiro  d .  f  .  Sinn.il  and  r>til<,e 

cospnnsp  fh)  of  riltor  Matc,'Oil  ;  . 


T!tc  volt  apt-  a!  the  output  of  *  ho  matched  fil’er  •' 
accord i np  to  Puhamol's  theoror 


i  1  pi ,  ;  p  v;  •  -ip  f  t 


i.  m 


j  •'  t  vi i? 


I  1 


i PCe  p  ( » - v  t 
r 

and  '.d-or  \ 


i  .*  i  !  -  ;  i  \  1  ,  i  ft-p  ,  t  1 1  i  ti  p  into  promt  t  h  a  ’  w’  •• 
]  ’ 

-  1  ,  ft  met  i  m  p  t  ■  x  t  i\  ui  'h-r  ■ . 
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i/  ,  •  (ft  a  \  •'  i 


.••in  •.  <  /'  t  vi  !  v 


a  [  ■"  i  v)  c,  t  v  •  -i  '■  v. 


where  the  des  i  mat  i  on  is  i  n :  rn.hf’od  for  -  t  .  't  mstap.t 


u  ■(/  )  a  \  i  "  '  v 


’■  cm!  j  t>i>  rite  volfape  tt  from  the"  1 1 1 1  p  1 1 1  •-  ot  n  ]  ]  the  filter-  nt  ip 

■uit 

slant  t  *  T  to  :  t-e  CiT'a  rtPor  circuit  wh  i  ch.  select';  the  svr<*''i  v  fro-  ••  •<  j 

r 

t  he  jjroatest  vol tape  lias  been  produc'd,  we  <”><■«  t  ;t  j  n  (tie  svstem  which  realir 

re  c  ep  t  i  on  i  n  c  o  n  f  o  r  m  i  t  y  v.  i  t  h  the  principle  of  expression 

:  Th  i  s  system  nav  he  penera  1  i  :<>d  for  the  .uu'  of  the  -vster  with  uneisu--  1  p 

in  siena  Is  r  (1)  hv  addine  the  appropriate  subtraction  device*:. 


I.et  us  observe  than  when  f  ■  .’  I  the  voltage  ;if  t  lie  output  n  f  the 
matched  filter  ami  caused  by  signal  z  (t)  act  i  nr  in  interval  (H/tl  euuals 

tern.  from  this  it  follows  that  the  readout  instant  when  the  next  element 
is  being  received  there  is  no  voltage  at  the  output  of  the  matched  filter 
caused  by  the  preceding  signal  elements. 

\  matched  filter  with  a  transfer  function  I  vs. "I  amounts  to  a  linear 
circuit  with  constant  parameters,  ''omotimos  it  is  convenient  to  refrain 
from  the  demands  of  constancy  in  a  filter  and  this  cield  additional  possi¬ 
bilities  for  designing  different  variants  of  an  optimal  decision  svster. 

I  lie  idea  behind  their  design  is  based  op  the  fact  that  euualitv  (  A.  ,v|) 
holds  if  the  pulse  response  of  the  filter  satisfies  condition  Is.sl)  on  I v 
over  tlu'  interval  i'  ■  t  T,  and  when  t  ''  it  mac  have  anv  value.  |f  a 
received  signal  r '  1 1 1  is  delivered  to  such  a  filter  at  instant  t  -  u,  at 

instant  t  *  T  a  read  ini’  eoual  to  •  V  can  be  talon  from  it  inasmuch  as  the 

r 

values  of  u  (t)  when  t  •  1  do  not  tale  part  in  the  limits  of  integration 
l.vo-n.  r 

However,  with  such  a  filter  the  remarl  made  .above  to  t''e  effect  t>'at 
its  reaction  to  preceding  elements  of  a  signal  will  fade  comnletelv  l'v  the 
instant  of  reading  of  the  next  element  does  not  hold.  thus,  i  v  t.l)  hob's 
only  for  the  first  received  element.  This  shortcoming  is  eliminated  com- 
nletelv  if  after  each  reading  the  filter  is  hrouent  to  zero  initial  condi¬ 
tions  by  damping  the  oscillations.  Ibis  can  be  done  by  shorting  all  capa¬ 
citances  of  the  filter  for  a  instant  and  opening  its  inductances,  f'erebv 
such  a  filter  becomes  a  circuit  with  variable  parameters,  periodicallv  re¬ 
jecting  the  energv  accumulated  in  its  elements. 

It  is  convenient  to  select  a  function  o  <  t)  of  such  a  filter  such  that 

r 

over  the  interval  M  •  t  -  t  -  T  it  satisfies  condition  ('5.51)  and  when 

t  T  it  continues  per i od i ca I  1 y .  In  other  words,  this  filter  can  be  matched 

in  the  sense  of  conditions  (.veil  and  I'.V)  with  a  per  i  od  i  ca  1  1  v  extended 
s  i  gnu  1  :  (.r  )  . 

In  the  narticul.ar  case  of  a  simple  circuit  when  z  It)  represents  a  see- 

»* 

rient  of  a  sinusoid,  an  ideal  oscillating  circuit  without  damping  with  a 

resonance  frenuerev  of  .  coinciding  with  the  ‘’rcuuencv  o*'  signal  z  (t-' 

p  r 

shorted  for  an  instant  after  each  reading  constitutes  such  a  filter.  'n  prac¬ 
tice  a  circuit  which  is  damped  much  less  than  T  is  used,  ‘Mich  circuits 

r 

with  variable  parameters  (with  a  periodic  reset)  have  been  called  commutated 
f i Iters. 

All  the  decision  systems  considered  above  permit,  at  instant  of  reading 
t  -  T,  obtaining  at  the  input  of  the  circuit  comparisons  of  potential  c.pia 1 
to  the  magnitudes  of  X  fwith  an  accuracv  to  a  common  factor).  However, 

when  t  <  T  the  potentials  at  the  output  of  the  matched  nr  commutated  filter 


-150- 


IT' • 


in  figure  a.  a  differ  erratic  from  the  no  t  <'n  r  i  1 1  k  ,it  t  lie  output  >*  ‘e  • 
tegrntor  in  figure  3.5.  i  or  us  illustrate  this  hv  tin'  eximple  where  the 
signal  is  a  citias  i  -harmon  i  o  with  n-  I  at  i  ve  1  v  slowlv  ohani'inr  amp !  i  t  trie  an,! 
nliaso  with  respect  to  . 

l(/i  ,•  '  *MO  1 

anil  ..  T  "  1.  let  tis  assume  that  signal  r  .  ( t  I  i  <  act  un  1  1  \  •  >  *  •  i  n  .•  *  nnsritin! 

i 

aiiii  that  interference  is  so  small  that  it  can  he  neglected,  so  thu'  ~ • 

=  .  I  f )  wi  tli  a  common  factor  of  nccuracv.  'lion  it  inst  mt  t  !  t*'<*  on 

i  — 

tential  ir  the  interrntor  in  the  svster  in  1  i  pure  tor  :n  . . 

filter  in  figure  3.  -H  is 

'  .  1 

u{  in  \  ti.vic.  '  (■•'  '  1  ■'  •>  ,A)  ‘ 1  * 


*  '  I"’’ 


i  \  I  c*  e  ,,‘n '  :  ‘h  i  \ .]  :  a 


fince  the  integral  of  i  ra»'idiv  esc  i  1  1  a :  :  "  e  ‘hire*  i 
euual  to  zero,  tl’e  second  term  'in  '  <■  i  gn  r<-'. 


'•  '  x  i  1 t  •  ! 


ii  HI  j  .  I  i  i  i 


i.r.,  the  voltage  at  the  in-orrr-r'  j*  :  - 

irui  eradua  1  1  i  rises  *';or  rote  t  its  •  iluc  ••  *•>»•: 
'  -  c  >pst .  th.  is  "oltaee  rises  lim'irh  11  .•  P'o 


,:’o  volt  ii’"  it  t*'e  output  of  i  r  ire1''-.!  •’  i  ■■  *■  •  '•••  • 

1  i  cure  o..',  is  define!  *>v  ''rrtil.i  '  •!*'<♦  ;  •  :  " 

r  ’  ;  t  1  •  z.<T'-  -  \  ( t'cos  f  r  »  •  *  1  when  '  *  ’  it'.1  •  et  • 
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is'  obtain  (,to  a  common  factor  <f  iceuracv' 


u  .  (n  j  ,\hk  ’  •  ,|,i '  !  ■' 1 '  *' '  ’ 


■  «  ! 
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'It  is  ens\'  to  ascertain  fha*-  the  second  iotoeri!  '■  i s  e- 
whereas  the  first  integral,  '-dor  t  .  'rant :  «r  *'■ 
integral  mae  )>e  di  srer  irde<i  for  all  values  o*‘  *  v’,,  •, 

larger  than  1  ’  , 
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It  is  easy  to  ascertain  that  in  t  ho  case  whore  signal  z-,(t)  is  in 

fact  transmi tted  the  error  probability  also  is  determined  from  (3.41). 
rheret'oro,  the  discrete  representation  of  such  a  channel  is  a  uniform 
svmmotri  -al  binary  channel,  whatever  signals  n  j  ( 1 1  and  r..,(t)  may  be. 

\  verv  important  conclusion  follows  from  (3.411.  The  minimal  proha- 
hilitv  of  error  is  uniquely  determined  hv  the  ratio  between  the  euui  valent 
power  of  a  signal  element  P  T  and  the  spectral  dens i tv  of  interference  \" 

(which  also  has  power  dimensions!  and  does  not  depend  on  other  parameters, 
including  the  frequency  band  occupied  bv  the  signal. 


T!ie  results  derived  mav  be  simple  interpreted  in  a  geometrical  wav. 

We  will  regard  the  lourier  coefficients  .a  and  ,.b  of  the  incoming  signals 

K  r 

as  rectangular  coordinates  in  a  B-dimensional  space  fl’  =  •’’IT  is  the  base  of 
the  systoml .  Then  each  of  the  two  signals  :  (ft  and  r,(t)  mav  be  repre¬ 


sented  bv  a  point  (or  vector)  in  this  H-d i mens i ona I  space.  The  received 
signal  :'(t)  ma>'  also  bp  represented  bv  a  point  with  coordinates 

or  by  a  vector  which  is  the  geometrical  sum  of  the  '-ector  of  the  arrived 
signal  ;(t)  with  components  ...u^,.h^  [V  -  V^ . 1  and  of  the  interference 


vector  with  components 


’!•  ’  1 


( i 


,  1.  .  IT.  i  s  presentation  is  implied 


to-  formula  (3,31,  it  is  apparent  that  the  Courier  coefficients  of  the 
interference  with  freutiencies  1 '  i n g  outside  of  tho  1  band  cannot  be  fa Von 
into  account  since  in  the  above-der  i  ved  ‘‘ormulas  for  the  reception  principle 
and  for  t''e  prolvjb  i  1  i  ?  v  of  error  these  coefficients  are  either  absent  or 


curt  a i 1 ed . 


becisiop  ’'rincinle  3.',3i  or  (  '..'-It  meanwhile  acutiire  a  vrrv  definite 
geonet  ri  cal  meaning.  Pm*  optimum  (in  the  sense*  of  the  maximal  livelihood 
criterion)  decision  svster  "Mist  choose  the*  possible  signal  whose  point  is 
neirer  than  the  'thers  to  the  point  <f  received  signal  :  ’  1 1 1  .  In  the  bj- 
nar\  c  isc  rhi<  principle  reduces  to  dividing  tho  1* -d  i  mens  i  ona  1  space  into 
•wo  sf>-j -spaces  hv  means  of  i  hvper’'lano  perpend  i  cu  1  a  r  to  and  Msecting 


hr  s  t r  a i g 


i, . 


line  connecting  the  points  ;  ( t  A 


ant! 


,  ( 1 1  .  I r  po i nt  ;  '  ( t ) 


1  r  «  in  •  w  r  same  s  em  i  -  sp  t  c  <■  as  7  i  •  '  r  h  r  1 !  ec  i  s  i  op  s  v  s  t  t,m  chooses  s  vmhp  ]  v 

m!  ice  •.  ers  1  ,  >  i  cure  3  s  sw,n,s  the  plane  drawn  Through  points  ;  ;  , , 

in.!  the  straight  I  .  ne  represents  the  intersection  or  this  plane 

..it1'  The  hvperplane  dividing  The  space  inTo  Two  recepTion  areas. 


1:  is  e.asv  •  >  see  ir  This  genre •  r  i  c  a  1  representation  that  the  value 

f  I'  r  3 .  3  s '  ]  t  ’•  a  1  f  The  son  ire  o'  the  distance  between  the  points  ropro- 

r 

senting  s  1  g-  a  1  s  *  •'  ml  7  „ 1  •  .  T’eeotinr  t1-is  !i  «t.incr  'p  p#  we  derive 

h  -  .?f“ 


S  erne  Times  T  j  s  called  the  '  n  T  e  )  '  T|  j  )  ev  1  i  s  ?  ,ancr  . 


•  1  v- 


a)  b) 


Fiqure  3.R.  flenme  t  r  i  cn  I  pei>resen  t  n  t  i  on 
or  Maximal  Likelihood  Criterion  for  a 
Minnrv  System. 

The  v  triable  '  represents,  :is  is  apparent  !’ r c>n  tin*  right  side  of  in¬ 
equality  the  scalar  product  of  tin*  interference  vector  n(tl  and 

the  difference  between  the  vectors  of  signals  . .  r  j  ( t  d  and  :  z  1 1 '!  .  Hut 

tli  is  scalar  product  may  he  represented  hy  projecting  m  of  interference 
vector  n(cl  on  the  straight  line  joining  points  ;  and  ^  and  mu  1 1 i p 1 v i nr 

hy  distance  P  between  these  points.  Thus,  inequality  (3.371  mav  he  written 
as 

-!,  L>:  .y  nil) 

or 

m  <  ■ 

[  3 .  -lol 

This  inequality  is  the  condition  for  correct  reception  of  a  trans¬ 
mitted  symbol .  Therefore  the  error  probability  is  the  probability  that  in¬ 
equality  (3. .131  will  not  he  fulfilled,  i.e.,  that  the  projection  m  of  the 
interference  vector  will  be  more  than  half  the  distance  between  the  points 
representing  signals  tjltl  and  :,(tl.  It  is  apparent  that  under  this  con¬ 
dition  the  point  representing  received  signal  z'ftl  will  not  he  in  the  semi- 
space  in  which  is  situated  the  point  corresponding  to  the  a-tuallv  trans¬ 
mitted  signal  (figure  3. ''hi,  and  an  error  will  occur.  It  i not  difficult 
to  derive  expression  (3.411  starting  from  non fu  1  f i  I  1  merit  of  condition  of 
i  ncuua  1  i  ty  (3.-131. 

Ive  would  observe  that  error  probability  is  affected  only  by  the  inter¬ 
ference  vector  component  which  coincides  in  direction  with  the  straight 
line  connecting  the  points  representing  signals  ~  ^  ( 1 1  and  ;,(tl.  The  in- 

terferenci  components  perpendicular  to  this  direction  do  not  affect  the 
error  probability.  This  property  is  characteristic  of  optimum  reception 
methods  in  the  cases  where  the  initial  signal  phases  are  1 nown  a  priori. 
These  reception  methods  are  usually  called  coherent. 

In  order  to  secure  the  greatest  potential  resistance  to  interference 
in  a  binary  system  the  signals  ~  f  1 1  and  z  -,  ( 1 1  must  t>o  so  chosen  as  to 


produce  the 
prose r i bed , 
P  =  1  /-’  (P. 

S  1 


greatest  possible  1’^.  Usually  the  average  signal  power  is 
which  with  ecpi  i  probab  I  e  a  priori  svmbols  y  and  v,  is 
+  1’,].  The  expression  for  I’  (3,3X1  mav  be  represented  as: 


P. 

L 


ni 


7  r 

-VO'fl-i  f (M-// 


7 


ii 


(3.44) 


With  given  values  of  P  +  P  ,  and  T,  a  maximum  of  is  obtained 
r 

if  1  ’i  (t>  in  !t  is  negative  and  maximum  in  absolute  value.  Accord  iiu1.  to 

ii 

the  Btinyakovsk  i  v-Shva  rt  s  i  neqtia  I  itv 


f  -'.(M-M'l./f 


7  / 


(l )  </' 


/ 


u. 


and  eijuality  is  attained  if  r.ltl  =  fa^ltl  where  ('  is  an  arhitrarv  constant. 
On  the  other  hand,  average  roomer  r  i  ca  1  >  T7” ^  P  ^  attains  a  maximal  value  cotta  1 
to  the  arithmetic  average  I\.  r  l'dlTj  +  P  ,1  on  condition  tliat  l’j  -  l\ , 
i.e,,  when  ('  -  1.  Thus,  to  obtain  a  maximum  of  P  ,  it  is  necesstiry  to 
take  f  =  1  -1,  i.e.,  z„(rl  =  -'Ml.  When  this  is  so  all  terms  in  the 
Pour  i  or  series  for  Z-.ftl  have  the  same  amplitude  as  do  terms  of  z^ftA, 
but  there  phases  are  shifted  1  so  . 


Thus,  the  binary  system  which  is  optimal  with  respect  to  resistance  to 
interference  is  the  one  with  an  active  pause  and  opposite  s 'finals.  Substi¬ 
tuting  Z-,(tl  =  - n j  f t d  in  (3.441  we  obtain  for  it  P^  =  41’^.  f’onsoquent  1  v , 

the  probability  of  error  according  to  (3.411  is 


P 


i 


H  I 


I J 


i 


■IMI'-Vl 


(3.431 


where  we  introduce  tlie  designation 


Ir 


(3.401 


The  magnitude  h“  represents  the  ratio  of  average  signal  element  power 
at  receiver  input  to  the  spectral  density  of  the  interference.  We  will 
use  this  symbol  throughout  the  whole  book. 
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We  are  often  interested  not  in  the  ratio  of  signal  element  power  to 

spectral  interference  densitv,  but  in  the  ratio  (P  /!’  1,.  of  the  powers  of 
'  s  n  I 

signal  to  noise  at  receiver  input  i fa  freuuencv  band  f  or  in  the  ratio  of 

the  spectral  densities  of  the  signal  and  i nter ference .  ^ i nee  I’  =  .1,  the 

fo 1 1 ow i ng  ra t i os  occur : 


where  •“  =  P  /!•  is  average  spectral  signal  densitv. 

1  ror  this  it  follows  that  a  prescribed  value  of  h  ma1,  b<>  produced  with 

anv  arbitrarilv  small  ratio  (T  ;P  ),.  or  •  -  if  the  signals  have  a  large 

s  |1  1 

enough  base  B  -  jl'l  . 

for  example,  when  h  =  a  the  probability  of  error  in  the  opposite- 

signal  system  is  1  /  2  f  1  -  !  (aid'!]  31  Mf"  .  If  here  IT  -  1,  the  ratio 

(P  /P  1,.  neeiled  to  produce  this  reception  reliabilitv  is  lr  -  11 .  Bur 
s  n  I-  1 

if  the  signals  have  a  large  base,  e.g.,  if  PT  -  10b,  the  same  error  nroba- 

bilitv  will  be  obtained  when  fP  /P  ),.  =  lv  /FT  =  0.00. 

s  nr 

It  must  not  be  thought,  however,  that  the  emplovner*  of  wideband  sig¬ 
nals  (signals  with  large  base)  permits  transmitter  power  reduction  at  a 
given  reception  fidelity.  In  fact,  the  interference  power  in  freuuencv 
band  !'  is  proportional  to  this  band  and  the  transmitter  power  needed  to 

secure  a  given  value  of  h  is  P  -  h~P  /..“TT  -  h“  “'.‘T.  Therefore  if 

s  n  " 

the  givens  are  signal  element  duration  T,  transmission  factor  ;. ,  and  spec¬ 
tral  interference  density  ■  ,  the  transmission  power  needed  is  uniuuelv 
determined  by  the  reqirred  value  h  and  does  not  depend  on  freuuencv  'wand  F 
occupied  by  t!te  signal.  Reduction  of  roouired  transmission  power  (or  re¬ 
duction  of  error  prolvibilitv  at  given  transmitter  power"!  can  K‘'  accorirlis'u 
only  by  increasing  .  (e.g.,  ’\v  using  directional  antennas'),  'n-  decreasing 
(e.g.,  if  interference  is  caused  bv  internal  receiver  noises,  by  lowering 
the  noise  factor) ,  or,  finally,  by  increasing  T  Cdece 1 erat i ng  transmission' 

If  signals  c(t)  are  relatively  narrow -band  in  the  sense  that  fre¬ 
quency  hand  F  is  considerably  lower  than  the  average  frequence  of  the  signi 
spectrum  (which  practical  lv  always  occurs  in  radio  channels'),  then,  as  is 
well  known,  any  signal  may  be  represented  as  the  uuas i -harmon i c 

cl/'  /■  in  C"' l"1,,/  !  f  .  "I'Fi|.  I3.J8) 

where  lift)  and  I (t)  are  relatively  slowly  changing  time  functions,  and 
during  one  period  of  "high-frequency  filling"  the  values  of  f  and  t 

may  with  sufficient  accuracy  be  considered  constant. 

Under  this  condition  the  average  signal  strength  is 
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urn!  peak  (maximum)  power 


/*,: 


M.\ 


/: 

in. i  ,\ 


where  !'  is  the  maximum  value  of  envelope  I  I  r  1  . 
max 


I  3..)0'l 


i  ?.  r<m 


from  the  above  fimlin.cs  it  is  el  ear  that  peal  power  value  does  not 

directly  affect  error  probability.  If,  as  is  often  the  ease,  t  rar  ■  :■  i  t  ter 

peak  power  is  limited,  then  in  order  to  increase  resistance  to  ini  •■•'eronce 

a  signal  sham'  must  be  chosen  such  that  the  pi  veil  peak  power  I’  fords 

ma  x 

the  greatest  possible  average  power,  !’  ,  i.e.,  signals  with  the  1  <  ■  > t  en¬ 
velope  peak  factor  must  be  used.  It  is  apparent  that  this  condition  will 

be  fulfilled  if  l'(t)  =  const,  since  in  this  case  I’  =  I’  and  the  peal 

s  ma v 

factor  is  uni  tv. 


•hie  simple  binary  system  with  opposite  signals  and  with  a  neal  factor 
of  unity  is  the  svstem  with  ISO°  phase  leving  (FT),  in  which  these  signals 
are  used: 

c,i/i  no  ;  «.*  '  ri.  1 

.’,(.'1  il  O '■>(«,/  |  >!  (I  O  («•/  •  •  r-\  r)  ]  3.a  1) 


It  is  very  simple  to  produce  an  optimum  coherent  decision  system 
(Figure  3.31  for  such  signals,  since  a  single  generator  of  cosf..t  *  f 
harmonics  is  used  ns  the  signal  simulator  whose  voltage  is  connected  to 
a  single  multiplier  as  shown  in  figure  3. fa.  This  svstem  records  symbol 
i  I'  at  the  readout  moment  t  =  T  the  voltage  at  integrator  output  (or  at 

optimum  filter  output  1  is  positive,  and  symbol  v is  this  voltage  is  nega¬ 


tive.  It  is  easily  ascertained  that  t h i <  system  conforms  to  the  principle 
of  expression  (3,2s).  Indeed,  when  ;,lt)  -  -r.  (t),  it  follows  from  ex¬ 
pression  (3.2b)  that  \\,  --  -\  and  the  principle  of  expression  (3. 2^)  may 
be  converted  to  the  form 


l 


1 


It  can  easily  be  seen  that  this  system  is  suitable  for  tnv  binarv  svstem 
with  opposite  signals  if  a  voltage  proportional  to  n  j  f  t )  is  delivered  as 
signal  simulator. 

\  simplpr  decision  system  can  be  designed  without  a  multiplier 
(Figure  3.9b)  which  is  equivalent  to  the  preceding  one  and  which  is 
called  a  phase  detector.  Here  the  sum  and  difference  of  the  arriving 

'The  value  /p  J?  is  here  called  the  peak  factor, 
max  s 


- 1  3f>  - 


signal  z ' ( t )  and  flu*  support  voltage  of  a  local  oscillator  cos  I . r  +  •) 
arc  formed  and  then  detected  separatelv  In-  mean-square  detectord  KP  and 
the  difference  of  the  detected  voltages  is  integrated  over  an  interval 
from  0  to  T.  As  in  the  preceding  system,  a  decision  as  to  a  transmitted 
symbol  is  reached  based  on  the  sign  of  voltage  H  at  the  output  of  the 
integrator  at  instant  of  reading  t  =  T. 


Fiqure  3 • ^ •  functional  Hi  an  rams  of 
Coherent  Reception  for  an  FT  System: 
a,  With  a  multiplier:  b,  With  a  phase 
detector . 

In  saving  that  these  systems  are  equivalent,  we  assert  that  with  de¬ 
livery  to  them  of  the  same  signal  '  ( t )  the  signs  of  the  voltages  at  their 
outputs  will  be  the  same.  Consequent  1 v ,  incorrect  decisions  will  arise 
simultaneously  in  both  systems. 

To  prove  this  assertion  we  will  write  the  values  of  the  output  voltages 
of  both  systems  at  the  instant  if'  reading: 

7 

■v>  t:  J  -\<n  c'lM./t, 

u 

; 

i '  J  ||f.'.’,  id  \  im|-  p.'.-,  in  mp;  >!i. 

where  C  is  an  arbitr.arv  constant. 

Removing  the  parentheses  we  obtain 

I 

r  c;  j  c,(/i .  ind/. 
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i.o.,  the  magnitude  of'  II  is  proportional  to  X  and,  consequent  1  y ,  has  the 
same  sign. 

In  addition  to  the  opposite-signal  systems  there  are  a  number  of 
other  binary  systems  which  are  of  interest.  U’e  will  here  mention  two 
classes  of  systems--those  with  orthogonal  signals  and  those  with  a  passive 
i nterva 1 . 

In  systems  with  orthogonal  signals  the  functions  ::  ft)  and  c^ft)  satisfv 

the  condition  of  orthogonal  i  tv  in  the  interval  TO  ,7'): 

; 

^  c,  i/i  •  in  It  °  ( .  fo) 

In  this  case  it  follows  from  expression  fa. -Ml  that  1'^  =  f  +  I’,,  -  .71’^. 

Substituting  this  value  in  expression  fa. -Ill  we  will  find  the  error  proba¬ 
bility  in  a  system  with  orthogonal  signals: 


Comparing  expressions  (a. SI)  and  fa.  IS)  we  mav  observe  that  in  order 
to  obtain  identical  signal  reception  probabilities  in  an  orthogonal  system 
we  must  have  a  power  i~  times  greater  than  in  a  system  with  opposite  sig¬ 
nals.  It  is  advantageous  to  have  1’  -  I’,  to  reduce  ronuired  peal  power, 

as  well  as  to  simplify  the  decision  system. 

fxamples  of  simple  orthogonal  systems  are  the  system  with  "i'°  phase 
keying  with  signals 


.*,1/1  c /  Cl"  t  >•! 

)  (/  -at  (.>•: 


-i, 

r  t  il 


(  S 


and  t lie  system  with  freuueney  keying  ffh'l  with  signals 

.*,  im  ;  ri.  | 

.*  .  I  '  I  (/  Ct  I  |  1 

•  •  I'.ruo 

Systems  with  signals  of  the  following  typos  may  also  sorve  as  oxamples 
of  orthogonal  systems  with  an  active  interval: 

-',(/! 

i/| 


ii c  ".i /.*,«■.'  r,t  •  «. ci"  r  ••  /  *  - 1 
11  -  it!  /  I  ;,l  •  c."  ('■  ...  /  :  r,t 


-Ml- 


when 


•MO 

t,  (0 

when 

m 

As  manv  such  examples 


nc"-g«H  1 1  when  n  !  <  1  -• 
0  when  7  /  <_  / , 

0  when  <•*■'  t  7 
</  or. (m/  !  r)  ■  when  //•_> /  n  /'. 

/  </ or  j  f)  when  (X/M/J, 
wo  »,|.v  !  r)  when  7  _’</<  7. 

(  u  or.  (/,•»<.  /  ri  when  1 1 ‘ ^  "C  ^ 

|  o >'(/.,»„/  :  ri  when  /_’•/•  / 

as  lies  i  red  coulc!  he  given. 


r-.r-s) 


i  '  .  rod  i 


As  is  apparent  from  (3.S4),  the  error  probabilities  for  all  the 
systems  given  here  are  t he  same,  provided  that  the  average  power  of  the 
incoming  signals  and  the  duration  T  of  the  signal  elements  are  also  iden¬ 
tical  and  if  reception  occurs  with  an  identical  level  of  white  noise.  Mmo 
of  the  systems  listed  have  an  advantage  over  others  with  respect  to  the 
peak  signal  power  reunited.  These  are  systems  f.s.Fo'),  (o.fuO,  and  fo.a'M, 
whose  peak  factor  is  unity.  Various  additional  considerations,  some  of 
which  will  he  discussed  helow,  prompt  us  to  prefer  one  or  another  of  these 
systems  in  various  specific  cases. 


Systems  with  a  passive  interval  are  a  particular  case  of  orthogonal 
systems,  '.'no  of  the  signals,  e  g.,  :  (tl,  may  he  any  time  function,  and 

;,(t1  =  ll.  It  is  apparent  that  here  the  condition  for  orthogonal  i  tv  (.".Ml 

is  fulfilled  and  the  probability  of  error  if  defined  hv  expression  (o..'4'i. 

it  must,  however,  he  borne  in  mint!  that  in  tins  case  I’  =  <  P ,  +  P,1  '2  - 

si. 

=  Pj  2,  i.e.,  the  power  of  signal  c^ltl  must  be  twice  as  great  as  the  signal 
power  in  the  equivalent  'rthogon.nl  system  with  an  active  interval. 

An  example  rf  a  system  with  a  passive  irterval  is  the  simp'e  svstem 
with  multiple  keying  l\!i  and  signals 


M'i 
•M/i 

Let  us  observe  tliat  the  error  prohahilitv  in  coherent  reception  for 
any  binary  system  nav,  in  conformity  with  expression  f'.Jll,  be  written  as 

f’  (I  T t ,//»].  I'.i'U 

where  coefficient  -.  depends  on  the  scalar  product  of  the  signals  and  is 
cqUu 1  t  o 
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Coefficient  v  mav  t  ike  values  from  rero  (when  z.  -  r  1  to  .  (when 

i  2 

a,  =  -z.).  When  i  =  0  the  prohahilitv  of  error,  as  should  he  expected, 

is  equal  to  W2  and  the  carrying  capacitv  of  the  cliannel  in  accordance 
wit!  (2.28]  is  equal  to  zero.  In  actual  fact,  signals  in  this  case  are 
indistinguishable  even  when  there  is  no  i nter ference .  lor  orthogotnl 
s  vs  terns  =  1  . 


The  prohahi  1  i  ty  of  correct  reception  of  a  svrnhol  ra\  expressed  a^: 

i . 


,  •hi,'o| 
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figure  5 .  1  n  shows  the  dependence  ot  p  >n  >•  as  enninod  'V.-"  •'omul  a 
(3. ul). 


t  T 

I 


•  r  Qt*t)  I 

Nv 


_lln  \ 


Figure  1.10.  rrror  Prohahilitv 
with  Coherent  necentior  in 
B  i  nca  ry  Sy  s  t  ems  . 

3.5.  F  r  ror  Probabilities  and  Potential  15  es  i  s  t  pci'  to  I  n ;  *  (>rt>-  <• 

Code  Base  m  ? 

If  a  code  with  base  n  2  is  used  t'-e  n'timur  lecisi  -p  prinT 
expression  (3.281  or  fa.  2")  ( der'em!  i  nr  on  whether  the  power  o'  .!! 
signals  variants  is  equall  remain  in  force.  'n  error  in  recei’  pw 
y  occurs  in  cases  where  inequality  ’.2^'  or  '3. 2"  is  not  tu’.'il 

at  least  one  of  the  values  of  subscript  r. 
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In  The  cane  --hen  the  a  pr.ori  proh.ih  1 !  1 1  ;  e<  are  not  identical, 

c.iiinus  average  Mpul  power  m  .iho  secured  hv  putting  The  coordinate 
origin  at  th.e  cef.Ter  ot’  ,;ravi:>',  hut  in  * ; '  ,,m  a  tu<-  proportional  to 
the  a  priori  probability  of  tie  correspond :  oj;  smihol  rrm  s  t  he  ittri'nited  to 
eve  rv  s  j  i»na  1  ■ :  r  t  . 


1  is- 


■ 


‘•either  •.tn  '  h  i '  integral  ‘  represent  eJ  1  v  ler.e  t  .ir  f  . 
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The  bi  orthogonal  system's  probabiiit}  ;f  correc*  reception,  c  c-  ~.j  ;  *  nl 
bv  analog'-  with  formula  i3.t>3  is  , 
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Hi : s  probability  of  correct  reception  is  less  than  for  an  equidistant 
system  with  the  same  values  of  n  and  h.  The  b iorthogona 1  systems,  however, 
make  it  possible  to  obtain  a  given  value  of  rr,  with  a  smailer  signal  ha>e  than 
do  the  equidistant  systems.  'Hi is  is  sometimes  an  advantage. 

Another  example  of  a  nonequ  id  i  stant  -stem  is  a  phase  i.oviru:  iH 
system: 
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In  r  h  i  ^  system,  regardless  of  m,  the  base  is  equal  to  2  and  the  signals 
ma\  he  represented  In  vectors  on  a  plane.  Mien  m  =  2  and  m  =  o  this  svstem 
is  equidistant  (for  r  =  a  its  geometric  representation  is  given  in  figure 
a.lla'l  and  when  m  -  I  it  is  hiorthogon.il.  Therefore,  for  these  values  of 
m  the  prohah i 1 i t v  of  correct  reception  can  he  found  from  formulas  n.Mhl, 
Io.pRI  and  (3."0)  respect  i  ve  1  v  .  ^pec  i  fi  ca  1  I  v  ,  for  m  =  •!  from  I  a .  ~  0 1  we 
nav  easilv  obtain  hv  a  suhstitution  of  variables 
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In  the  general  case  it  follows  from  decision  principle  (3.24)  that  in  a 
system  with  a  matched  filter  a  decision  that  signal i  ft)  was  transmitted  must  he 

reached  if  the  initial  phase  of  the  voltage  at  the  output  of  the  filter  is 
within  the  limits  from  f?r  -  3l--/m  to  /  2r  -  IV-  m.  \n  error  occurs  if  the 
phase  lies  outside  these  limits.  Py  using  as  a  prohahilitv  distribution 
phases  of  a  sinusoidal  signal  with  gaussian  noise  (20),  we  can  compute  the 
prohah  i  life-: 
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where  \  (V.  //» 
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is  a  Nicholson  tabulated  function 


With  large  values  of  m  and  h  the  following  evaluation  is  quite  accurate: 

.  r . 
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Generally  spealing,  with  an  increase  in  tlie  base  of  code  m,  if  the 
power  of  the  signal  P  T  and  the  spectral  density  of  the  noise  remain  un¬ 
changed,  the  prohahilitv  of  correct  reception  of  an  element  decreases.  If 
the  power  of  the  signal  and  the  rate  of  information  transmission  remain  the 
same  fin  this  case  T  and  consequently  !r  ,  increase  proportionally  to  log  ml, 
the  equivalent  probability  of  correct  reception  may  increase.  An  example 
of  this  is  provided  by  the  comparison  of  orthogonal  systems  with  m  =  2  and 
m  =  .32  provi  ded  in  f  1 )  . 
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3.6.  Decision  System  _,od  pesistance  to  Interference 

In  the  preceding  sections  it  was  assumed  that  the  additive  inter¬ 
ference  was  normal  white  noise,  i.et  us  see  how  the  finding,  change  if  the 
interference  is  normal,  as  before,  hut  not  white. 

The  problem  of  choosing  the  optimum  decision  svstem  and  figuring  the 
probability  of  correct  for  incorrect")  symbol  reception  in  normal  noise 
with  a  nonuniform  spectrum  may  be  reduced  to  an  analogous  problem  with 
white  noise  by  using  the  following  method  which  was  first  proposed  hv 
V.  A.  Hotel ' nikov  Til. 

The  problem  of  designing  the  optimum  decision  svstem1  (optimum  re¬ 
ceiver)  with  any  given  signal  parameters  has  been  solved  in  the  case  of 
white  noise  (see  Section  3. 3").  N'ow  let  a  signal  plus  normal  noise  with  a 
spectral  power  density  of  fi(.)  be  present  at  receiver  input.  If  this  mix¬ 
ture  of  signal  and  noise  is  passed  through  line  filter  1^  with  frequence 

characteristic  :(j..)  satisfying  with  accuracy  to  a  constant  factor  the 
cond i t i on 


|'b 


f  e ,  "’.'’l 


the  noise  at  the  filter  output  will  remain  normal  (since  filter  :  is 

linear),  but  will  prove  to  be  white  (since  its  power  spectrum  will  he 
("•  LA  ‘  (L.)'-  =  1).  The  signals  at  the  output  of  filter  '  will,  of  course, 

be  different  from  the  signals  at  its  input.  ^ i nee  we  know  the  expected 

signals  "  (r)  ,  ~  (t) , . . . , c  (t)  at  filter  input,  however,  and  we  determine 
I  ..  m 

filter  characteristics  l(;),  we  can  find  signals  5  ,  r  1 3  ,  r. ,  ( 1 1  ,  .  .  .  ,  r  f  t  A 

I  n 

at  the  output  of  filter  !^.  I.et  us  observe  that  condition  (a.  "I")  defines 

only  the  modulus  of  the  frequency  characteristic  of  filter  :  ,  while  its 

phase  characteristic  may  be  chosen  at  will.  The  physical  feasibility  of 
such  a  "whitening"  filter  is  assured  if  the  spectral  power  density  ('•(..) 
satisfies  certain  conditions  ,  in  particular,  if  it  does  not  take  on  the 
values  of  zero  or  irfin;tv  in  a  finite  segment  of  fre  piencies  .. 


I.et  us  now  connect  the  output  of  filter  :  to  the  optimum  decision 


1  Although  the  present  chapter  deals  with  optimum  decision  systems  prin¬ 
cipally  from  the  angle  of  the  maximal  likelihood  criterion  the  following 
discussion  holds  true  for  any  criterion  of  optimality. 

•The  conditions  for  the  realizability  of  filter  :  coincide  with  those 

under  which  the  noise  with  power  spectrum  (•(."!  is  indeterminate  and  those 
conditions  arc  always  fulfilled  in  pr.-.etice  f~l. 
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system  PlI  designed  for  the  new  set  of  signals  iff)  received  against  a  back¬ 
ground  of  white  noise  (figure  3.12a').  We  will  demonstrate  that  the  combina¬ 
tion  of  filter  and  decision  system  I’C  is  the  optimum  decision  svstem 

for  signals  z(tl  received  against  a  given  background  of  colored  noise. 

Let  us  assume  that  our  statement  is  untrue.  Then  there  must  exist 
some  other  decision  system  PC.,  which  better  satisfies  the  criterion  of  op¬ 
timality  than  the  system  shown  in  figure  3.12a.  Let  us  connect  two  filters 
in  series  to  decision  system  PC,  i nput- - f i 1  ter  which  was  mentioned  above 

with  frequency  characteristic  I  (  i  .  1  and  filter  :,  with  frequency  character¬ 
istic  1  !  (j^)/  1  (ju>) ,  (figure  3.12b)1.  Since  the  series  connected  filters 
and  I,  do  not  change  the  signal  and  interference  entering  them,  the  svs¬ 
tem  of  figure  3.12b  is  entirely  equivalent  to  decision  svstem  PC,.  Lliite 
noise  and  signals  of  z(t1  are  present  at  the  output  oF  f  Iter  !  Therefore, 

that  part  of  the  figure  3.12b  system  contained  in  the  broken  line  mav  be  re¬ 
garded  as  the  decision  system  which  signals  z(t‘)  arrive  against  a  background 
of  white  noise. 


</Ctlv)  [ - 1 


a) 

G  M 

i/C(ui]  I - —  -  ~  — 1' 


b) 

Figure  3.12.  Decision  System  with  Daussian 
Noise  and  Nonuni  form  Spectrum. 

According  to  the  assumption  made  the  decision  svstem  PC,  satisfies  the 

criterion  of  optimality  for  signals  :(t)  against  a  background  of  white  noise 
better  than  does  the  system  of  figure  3.12a.  Hence,  correct  decisions  will 
he  found  more  often  at  the  output  of  the  figure  3.12b  system  that  at  the 
output  of  the  figure  3.12a  system.  If  this  is  so,  the  part  of  the  svstem 

'Physical  realizability  of  filter  :,  is  not  required  here,  since  this 

filter  is  needed  only  for  the  line  of  reasoning  being  pursued.  It  is  alone 
sufficient  that  series  connection  of  filter  !,  and  decision  svstem  PC, 

he  physically  realizable  [ID].  It  may  be  proved  that  this  condition  i < 
always  fulfilled  if  signals  zft)  are  of  finite  duration  and  power. 


in  Figure  3.12b  within  the  broken  lino  better  satisfies  the  criterion  of 
optimality  for  signals  zft)  against  a  background  of  white  noise  than  does 
decision  system  PC  .  But  this  contradicts  the  condition  according  to 

which  PC  is  the  optimum  decision  system  for  signals  z(tl  with  white  noise. 

This  contradiction  proves  that  the  Figure  3.12a  system  is  the  optimum  deci¬ 
sion  system  for  the  initial  z(t)  signals  received  against  a  background  of 
normal  noise  with  power  spectrum  (!(.). 

\  question  is  often  raised  as  to  the  case  in  which  maximum  probabi¬ 
lity  of  reception  of  given  signals  will  be  higher--with  white  noise  or 
with  noise  of  the  same  strength  but  with  a  nonuni  form  spectrum.  In  the 
form  stated  this  question  is  not  definite  enough,  since  how  to  compare 
noise  intensity  is  not  indicated.  It  is  impossible  to  compare  white  and 
colored  noise  at  full  power  because  the  power  of  ideal  white  noise  is  in¬ 
finite.  Mien  they  are  compared  with  respect  to  spectral  density  the  fre¬ 
quency  at  which  it  is  measured  must  be  indicated. 

The  author  of  work  [9]  examines  the  maximum  interference  resistance 
of  simple  signals  with  noise  of  a  symmetrical  frequency  characteristic 
having  a  single  maximum  at  the  average  signal  frequenev  where  the  spectral 
density  is  also  measured.  Here  it  is  not  the  maximum  probability  of  cor¬ 
rect  signal  reception  characterizing  potential  interference  resistance  and 
realizable  in  an  optimum  decision  system  fe.g.,  that  of  Figure  3.12a'!, 
which  is  computed,  but  the  error  probability  which  may  be  obtained  by  using 
a  system  which  is  optimal  for  white  noise  fi.e.,  without  use  of  a  "whitening 
filter).  It  is  apparent  that  the  thus  computed  probability  of  correct  re¬ 
ception  will,  generally  speaking,  be  less  than  maximum,  Nevertheless,  it 
is  larger  than  with  white  noise  and  monoton i ca 1 1 v  increases  as  the  effective 
width  of  the  interference  spectrum  is  narrowed. 

It  appears  that  even  with  any  normal  noise  frequency  characteristic 
the  probability  of  correct  reception  of  given  signals  will  he  no  less  than 
with  white  noise,  if  the  comparison  is  made  with  respect  to  the  same 
values  of  maximum  spectral  density. 

It  musi  be  emphasized  that  these  findings  are  true  in  the  ease  where 
the  noise  has  a  nonuniform  spectrum  at  the  very  hiput  of  the  receiving  de¬ 
vice  where  the  signals  have  given  shape  zft).  The  relationships  will  be 
absolutely  different  if  the  noise  spectrum  becomes  nonuniform  because  of 
having  passed  through  a  circuit  with  a  nonuniform  frequenev  characteristic 
connected  between  the  receiver  input  and  the  decision  svstem.  Here  it  is 
obvious  that  even  a  signal  passing  through  the  selective  circuit  will  change 
its  shape,  so  that  noise  of  irregular  frequency  characteristic  and  mod i - 
ficil  z(t)  signals  will  he  present  at  the  output  of  the  circuit. 

Of  course,  such  a  selective  circuit  is  unnecessary  with  regard  to  pro¬ 
tection  against  fluctuation  interference.  The  optimum  decision  svstem  with 
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white  noise  may,  is  shown  above,  contains  no  line  filters  at  all  (Tor 
example,  Figures  5.2,  5.5,  5.5,  etc.)  Nevertheless,  in  practical  receiver 
circuits  frequency  selectivity  is  always  provided  for  two  reason1'.  First, 
as  will  he  shown  in  Chapter  VI II ,  frequence  selcctivilv  is  often  needed 
for  protection  against  lumen,  noise.  Second,  even  if  there  were  on  I v  fluc¬ 
tuation  interference  its  power  in  the  absence  of  frequency  selectivitv 
could  become  so  g-eat  that  nonlinear  phenomena  would  begin  to  exeri  a  dis¬ 
turbing  effect  on  the  operation  of  the  decision  system. 
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Figure  3.13.  Decision  System  with  Freciuencv- 
Selectinq  Circuit  [FSC]  at  Input. 


In  conformity  with  the  above  finding  the  optimum  method  of 
in  this  case  amounts  to  feeding  the  signal  and  noise  which  have 
through  the  frequency-selecting  circuit  to  filter  ij  to  convert 


recent i on 
passed 
the  noise 


into  white  noise  and  then  in  feeding  it 


to  decision  svstem 


!V 


( i  cure 


5.15a).  Rut  it  is  easy  to  see  that  is  a  filter  with  frequency  charac¬ 


teristics  opposite  to  that  of  the  selective  circuit.  Therefore  at  the  out¬ 
put  of  filter  I j  will  he  signals  of  the  original  shape  rft)  against  a  back¬ 


ground  of  white  noise,  and  the  decision  system  will  operate  iusf  as  if  there 
were  no  selective  circuits  in  the  receiver,  Consequent 1 v ,  the  maximum  pro¬ 
bability  of  correct  reception  (potential  interference  resistance)  does  not 
change  if  the  signal  together  with  the  interferon  e  is  passed  through,  a 
reversible  frequency-selecting  circuit.' 


'This  result  is,  of  course,  also  true  for  any  reversible  circuit,  including 
a  nonlinear  one.  Hence  it  also  follows  that  the  carrying  capacity  of  the 
channel  does  not  change  when  anv  reversible  circuit  is  connected  into  it 
after  the  interference  sources. 
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I'hc  system  in  t  igure  3.1 3a  cannot,  however,  orlinarilv  lv  u^cd  in 
practice.  IT.e  situation  is  that  the  emploment  of  a  frequence  -  sc  1  rot  i  ni' 
circuit  in  the  receiving  unit  pursues  the  definite  aims  which  were  relate 
ibove.  i'lte  inclusion  of  filter  '  behind  the  selective  circuit,  hour-.cr, 

is  equivalent  to  cancel  inn  frequence  selectivitv.  Iherefore  in  nreferet 
to  the  system  in  l-'igure  .~.1Ti  is  to  he  used  that  in  !  igure  n!"h  where 
after  the  selective  circuit  the  signal  plus  interference  enters  a  dcci 
s vs  ten  containing  no  filter  1^  and  not  disturbing  the  frequence  select  i 

introduced.  hut  since  such  a  decision  svstem  differs  from  that  in  1  i  i*  i :  • 

' .  1 3,i  it  is  no  longer  optimum.  Therefore,  the  use  of  linear  selective 
cuits  before  the  decision  system  should  increase  the  prohahilirv  of  ei • 
caused  hy  fluctuation  interference  (in  particular,  white  noisei. 

Ihe  immediate  factors  causing  the  rise  in  proha  i  1  i  tv  of  error  in  * '■ 
case  are,  first,  depressed  signal  power  (from  suppression  of  a  portion 
of  the  signal  spectrum  in  the  selective  circuit')  and,  second,  expansion  . 
tlic  signal  in  time  during  transit  through  the  selective  circuit.  The 
second  reason  plays  the  greater  role  and  is  the  reason  that  reception  o' 
a  given  signal  is  disturbed  not  only  hy  fluctuation  interference,  hut  al< 
hy  the  noise  resulting  from  transient  processes  in  the  selective  circuit 
which  were  in  turn  provoked  hv  the  preceding  elements  of  the  signal. 

In  order  that  a  linear  selective  circuit  in  the  receiver  not  result 
in  perceptible  increase  in  error  probability,  the  reuni rement  must  ob¬ 
viously  he  made  that  its  effective  passh.and  he  of  ndeuuate  site  in  com¬ 
parison  with  the  effective  width  of  the  signal  spectrum  and  that  the 
transient  processes  in  the  prescribed  passhand  he  damped  as  quick lv  a^ 
possible.  This  last  requirement  is  known  to  he  met  if  the  resonance 
response  diagram  of  the  selective  circuit  is  close  to  gauss i. in  f he  1 1  - 
shaped',  [9],  If  the  effective  passh.and  of  a  gauss  i  an  filter  exceeds 
F  *  h/T  to  !'  +  10/T,  where  I  is  the  conditional  frequence  hand  occupied 
by  the  signal  (3.-H  and  T  is  the  duration  'f  a  signal  element,  then,  as 
many  examples  show,  it  is  possible  to  ignore  the  decrease  in  signal  power 
and  the  effects  of  transient  processes,  hy  using  such  a  filter  as  a 
selecting  circuit,  it  is  possible  to  not  consider  it  in  calculating  the 
probability  of  errors  caused  hy  fluctuation  i nterfe rcnce . 


‘It  should  he  observed  that  so-called  "uuas i -opt imum"  filters  or  selec¬ 
tive  filters  with  a  given  characteristic  performance  curve  and  optimum 
passhand  determined  with  regard  to  obtaining  the  maximum  signal  voltage 
to  noise  voltage  ratio  (c.g.,  see  fl°]1  ;annot  serve  as  examples  of 
optimum  selective  circuits  in  the  case  under  consideration.  The  fact  is 
that  the  passhand  of  a  quas i -opt i mum  filter  is  chosen  without  regard  to 
the  transient  processes  caused  hv  the  preceding  elements  and  that  its  op¬ 
timality  occurs  only  during  reception  of  single  pulses  separated  In¬ 
considerable  intervals  during  which  the  transient  processes  have  time  to 
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'V  irror  taint  di  st  i  not  i  on  in  the  transmission  o'-  ro<:  in  i  .  hupi 

with  i  nonuniforr.  interference  spectrum,  in  rornar  i  ^on  with  t'-e  rise  o*' 
wh  1 1  o  noise,  shou  1 1!  '>o  stressed.  Kith  uhito  noise  t’v'  rroh.ih  i  i  i  t  '•  o' 
error  •depends  on  flic  ratio  h  I'otuoon  «=  i  vtiiti  1  ivkit  mil  the  spectral  Vnsit 
of  noise  and  on  rfe  mutii.1  1  ratio  of  signals  uh  i  oh  is  expressed  in  ’ho 
case  hy  coefficient  •.  in  formula  n.opi  hut  does  not  depoti  '  on  tho  "fino 
structure"  of  tho  signal.  Thus,  with  opposing  :irnals  th.o  prohaM  !  i  \  v  o- 
error  is  expressed  hv  forwu'a  (o.  ’.i]  an!  with  l  r  ■.non  i  gn  1 1  power  does  imi 
depend  on  its  shape,  spectrum,  -re. 


Ibis  property  i  <  not  retained  with  ,i  nomini  form  1  nt  e  rt  rrrncc  smvt  run . 
In  t  h  i  ^  case  various  values  of'  h  m:iv  correspond  to  signals  uith  the  s.-ime 

i  « 

power  •;.  /  \  !-s«  ‘,yl.  From  (3. "3  it  is  apparent  tli.it  Tin-  1  irgest  h  is  pro- 


vi tleil  bv  those  signals  for  which  the  modulus  f> f  spectral  tlcnsjtv  .litters 
from  :ero  only  in  that  hand  of  frequenc  i  es  where  the  spectral  noise  density 
1  is  sufficiently  small.  This  conclusion,  i  no  i  .lent  a  1  1  v ,  is  rather 
trivial.  \  more  detailed  theorv  permits  determining  the  shape  of  an  op- 
timal  signal  depending  on  <"(.3  if  it  exists  f R 1 .  In  some  cases  there  is 
no  such  optimal  signal.  thus,  if  ('(  t  Increases  nonet  on i ca 1 1 v  uith  .m  in¬ 
crease  in  frequence  la  rather  frequent  event  3,  ot»v  i  mis  1  v ,  t''e  higher  the 
frequence  range  in  which  most  of  the  signal  enerpv  is  concent  rate.!,  the 
less  will  he  the  prohah  i  1  i  t  v  of  erri'r.  Usual  I  v,  however,  additional 
limitations  are  imposed  on  the  range  of  treipienc i es  used  which  .!.  not  permit 
increasing  the  resistance  to  interference  as  much  as  lesire.l  through  sue1’ 
a  method. 


3.7.  Carryinq  Capacity  of  Constant  Parameter  Channel  with  Additive  Noise 


let  us  compute  the  carrying  capacity  of  the  channel  in  question.  !o 
define  the  carrying  capacity  we  must  first  of  all  come  to  agreement  about 
the  restrictions  imposed  (in  the  signal.  It  is  most  natural  t  ■  limit 
the  average  power  of  the  incoming  signal  and  its  base,  let  u;  then  fore 
first  calculate  the  carrying  capacity  of  a  channel  in  which  s.gnals  of 
power  1’  and  element  duration  T  may  he  transmitted  with  given  base  !<  -'FT, 

if  white  noise  of  spectral  density  is  assumed  to  aceompanv  the  signal, 
he  impose  no  restrictions  on  m,  t>  o  code  base. 

I  very  signal  over  time  I'  mav  h0  represented  hv  a  finite  1  ourier  series 
(.3.73  in  which  7FT  coefficients  are  not  identically  euual  to  :ero.  the  in¬ 
formation  carried  by  a  signal  is  confined  in  the  values  of  these  coeffi¬ 
cients,  each  of  which  hears  its  share  of  the  information.  If  the  values 
of  the  individual  coefficients  are  statistically  independent,  then  the  whole 
quantity  of  information  in  the  signal  is  the  sum  of  the  partial  quantities 
of  information  carried  by  each  coefficient.  Statistical  dependence  bp- 
tween  these  coefficients  can  by  its  presence  only  decrease  the  total  amoun’ 
of  information. 


To  find  the  carrying  capacity  we  must  determine  the  signal  structure 
which  provides  the  maximum  t ransmi t tab ! e  information.  Therefore,  we  must 
assume  that  all  the  Fourier  coefficients  are  statistically  independent 
random  variables.  Signal  power  must  be  somehow  distributed  among  the 

Fourier  coefficients.  I.et  us  suppose  that  this  distribution  has  been  per- 

•>  -» 

formed  in  such  a  way  tha  the  powers'  ef,  ,  fall  to  the  lot  of  a,  b  , 
respect i \ e 1 y : 

'Since  a  b,  are  random  quantities  (determined  by  signal  selection  in  the 

K  K  ->  -> 

transmitting  unit!  the  powers  ,  •“  represent  the  mathematical  expec- 

o  K  n  \  —  - 

tations  of  the  squires  of  these  cocf  f  i  c  i  ent  s  - -aj3 ,  b“. 
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the 


i  ft'1 
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*, 


number  ot‘  term.1"  ,  n  this  sum  is  _’H  ,  -  1^  • 

the  maximum  quant  it  v  ot'  i  n  format  i  on  t  r.msmi t  tod  over  t  s-r  » 

•» 

efficient  a.  u  i  t  b  power  ,  ,  .in<!  then  let  us  def<-rri"t  ‘on,  1  i-v  ?  i  i 

K  H 

tribute  tho  highest  total  rate  i  f  inform.it  ii.n  t  r.ipsr  1  s<  j  -  >n  ,  w1-  >  ,  a 

viouslv,  will  equal  t  he  channel  carrving  oapaoitv  u’liler  *h**  or.  on  ondi 
t i ons . 

Ihv  qi’.intitv  of  in  format »  n  contained  i  v.  random  v  it:  iMe  '  t  »-.• 

Courier  coefficient  of  the  received  signal*  w  i  t  b  re«pec*  '  *r  <  r- •  1  r  •  .  r.  i*> 1 « 
at  (the  fourier  coefficient  of  the  t  ransmi  1 1 signal  o'  1  e  p  ■  i  •  sen'  <  1 

•>v  the  different  entronv  fror.  formula  (I.Tun- 

/,  (  1» .  i/«d  M  1*1  h  (.-It,  '</>•*  ;  _  - ' 

But  =  a^  »  ,  from  which  it  is  easy  to  show  th.it 

/i  (.1  |a  1  h  in  1  1  ' 

Actually,  the  conditional  probabilities  of  gettim*  i  »*•*.  e  i  v  <*d  pimti'v 
when  the  transmitted  ouartitv  a  is  shown  are  no*1  mm’  else*  ‘mr  *h«.  *•*■<  . 

bability  of  additive  interference  ^  ,  ind  since  en trope  :.s  ui  i  nie’r  d<**<" 

mined  by  the  probability  d  i  y  r  r  i  hut  i  >n  ,  *'ror  this  f  •  > :  |  ow  <  I  '  ,  . 

The  first  point  of  our  planned  program  is  t  hero'Vp'  fulfill*':  '■ \ 
finding  the  maximum  possible  value  of  t'u>  variable 

/  r  I  1*.  ./*>  h  I  lint1  A. 

IT.l  magnitude  hf*,1  is  determined  'n*  i  r.t  or  I’ererc*  in  I  does  *.  :  ! 

on  the  signal.  Therefore,  the  problem  reduces  to  fin. line  t1'*-  -■.r  ■  i di: 
ferential  entropy  of  received  signal  hl'A  A  .  The  power  ot  •*l".  i  mis  ;  . 

the  sum  of  jhe  power  of  a^  and  ,  since  these  magnitudes  ire  r  •  ■  T  t  v 

i  ruiependent . 

In  information  theory  it  is  proved  fe.g.,  [  1 01  'i  that  w  i  •  '*  i  civ  en 
dispersion  of  n  random  variable  the  greatest  differential  ent ro*n-  is  se¬ 
cured  when  its  probabilities  are  normal  h*  distributed.  Consentient ! v 
1  (\j,a^)  has  the  greatest  value  if  A  -  a  *  is  a  random  juanti'v  u :  1 1> 

normal  probability  distribution.  Since  * ^  has  normal  distribution,  i*  is 

necessary  and  sufficient  that  a^  also  have  normal  distribution. 

Up  until  now  we  line*,  examined  only  discrete  col  leet  i  ons  o*'  signals  , 
and  a  is,  generally  speaking,  a  discrete  random  variable,  the  number  o' 
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Thus,  such  a  strong  limitation  imposed  on  the  sir.e  of  the  code  base 
increases  the  carrying  capacity  by  only  ••/.’  times  in  comparison  with  the 
■  ase  in  which  there  a’-e  no  limitations  placed  on  the  method  of  coding. 
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The  carrying  capacity  of  a  binary  charnel  with  a  Riven  power  of' 
signal  P  and  a  spectral  densitv  of  additive  white  noise  v  when  the  sig¬ 
nals  are  net  opposed  hat  orthogonal  is  also  of  interest.  In  this  case 
(see  (o.54)l 

r  !  (i  -  •i-i'j.| 

Reasoning  in  the  same  wav  as  above 

r  1  >‘i 

It  follows  that  the  transition  from  opposim'  signals  to  orthogonal 
signals  cuts  the  carrying  capacity  in  half. 

Notes 

1.  (See  Section  .".dl  Manv  wo  rl  s  on  comrain  i  cat  i  on  thoorv  (including 
.1  number  hv  ('.  I:.  Shannon  1  are  'vised  on  the  conception  or  signal  and  noise 
as  processes  with  their  amplitude  or  power  spectra  lumped  entire!'-  in  a 
limited  f'reuuencv  band  v.  Tb  i  s  rates  it  possible  *.->  use  1  ote  1  ’  n  i  ’•  ov 1  < 
well-known  readout  theory  (e.g.,  sop  MoV}  whir1’  allows  a  coat  i  nuous -t  i  m*’ 
problem  to  be  reduced  to  a  d i sereto- t i me  problem. 

'erv  serious  objections  have  been  ad'-aneed  in  opposition  to  this  con¬ 
cept ,  first,  1  imi  ted-spect  run  signals  are  not  in  principle  roalirnMr 
since  they  must  he  infinite  in  duration.  Second,  everv  process  with  a 
limited  spectrum  is  singular  or  determinate.  This  means  that  the  value  of 
this  process  may  he  restored  at  anv  moment  in  time  over  anv  finite  segment 
of  it  [4],  Hence  it  follows  that  all  the  information  included  in  a  ]imit->d- 
spcctrum  signal  is  contained  in  anv  arhitr.arilv  s^all  segment  of  it, 

1'hc  condition  of  nonsingufari  tv  of  a  process  with  a  power  spectral  den¬ 
sity  of  (!(.  1  amounts  to  convenecncv  o*'  the  integral 

r.  r, .» 

I  .  '  •'*** 

I  I  iu 

This  condition  is  broken  if  in  anv  finite  freuuenev  segment  =  11 , 

and,  in  particular,  if  ffwl  differs  *'roir  rero  onlv  in  a  finite  band. 

Let  us  note  that  this  condition  is  similar  to  the  i'a  1  ev-Ki  oner  f^l  stipu¬ 
lation  physical  rca  1  i  r.ab  i  1  i  t  v  of  linear  svstems  which  savs  that  i  r 
Sfi.-)  is  tiie  frequency  characteristic  of  the  real  iced  circuit,  integral 

7 
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converges,  from  this  it  is  easv  to  conclude  that  if  an  indeterminate  pro¬ 
cess  is  fed  to  the  input  of  this  circuit,  then  the  process  at  its  output 


we  obtain 
1  r;  . 


( ~  _  nn  i 
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will  1 1  so  ho  i  inlet  enni  nate.  1 


for  this  reason  it  mav  he  stated  that  communication  theorv  mav  draw 
meaningful  conclusions  onlv  from  the  examination  of  indeterminate  pro¬ 
cesses  which  have  an  unlimited  spectral  extent,  to  which.  Kot  e  1  '  n  i  1  ov  '  s 
theorem  does  not  apply.  The  observation  must  <>o  made  that  in  one  o'  his 
worts  fl],  which  is  devoted  to  the  theorv  of  potential  interference  re¬ 
sistance,  Kotel'nil-ov  does  not  mate  use  of  his  own  theorem. 

Khat  has  been  stated  in  no  wav  contradicts  the  pos« j n j  1 ,  t v  that  an 
indeterminate  signal  mav  exist  which  is  representable  in  interval  in,'!") 
by  a  1'ourier  series  with  a  finite  number  of  coefficients  different  from 
zero,  i.e.,  bv  a  finite  trigonometric  polvnomial.  vMich  a  signal  serment, 
being  limited  in  time,  has  an  infinite  spectral  extent.  rtis ,  for  exarch  , 
the  segment  of  signal  r.(tl  =  a  cos ,  t  (o  t  ■  '"l,  with  on  I  v  ope  I'ourier 

coefficient  different  from  r.ero,  has  some  amplitude  spectral  densitv  un¬ 
limited  by  any  hand 
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The  extent  of  a  signal  power  spectrum  composed  of  a  seonence  of  ele¬ 
ments,  each  of  which  is  represented  bv  a  finite  trigonometric  polvnomial, 
is  also  infinite.  Nevertheless,  a  signal  element  mav  be  regarded  as  a 
segment  of  a  periodic  process  of  period  T  when  this  periodic  "recess, 
being  determinate,  may  have  a  spectrum  concentrated  in  a  finite  bp, id. 

based  ui  physical  considerations  it  is  clear  that  anv  signals  and 
interference  in  actual  communication  svsfems  are  nonsingular.  Neverthe¬ 
less,  in  the  solution  of  various  problems  resort  is  often  had  to  mathema¬ 
tical  idealisation,  replacing  a  nonsingular  process  with  a  singular  one 
close  to  it,  specificallv  !\v  a  process  with  a  limited  spectrum.  In  so 
doing,  despite  a  verv  good  approximation  of  a  spectrum  tin  the  sense  of 
absolute  or  mean-sciuare  error)  it  is  possible  to  obtain  paradoxical  results 
[13,14].  Thus,  a  signal  as  weal  as  desired  mav  be  detect!'!  with  a  nro- 
h ah i 1 i t v  of  unity  against  a  background  of  singular  noise,  furthermore, 
even  with  white  noise  it  is  possible  with  as  small  a  nrcbabilitv  of  error 
as  desired  to  detect  the  presence  or  absence  of  a  weal  signal  against  a 
background  of  noise,  observing  it  for  a  given  t,  if  the  received 

signal  together  with  the  noise  is  passed  throu  "i  a-  ideal  pi-sh.iped  filter. 
The  process  at  the  filter  on  •■put  will  have  a  soect  urn  limited  in  >\»n,|  and 


'it  may  tnerefore  in  particular  be  stated  that  if  <:(.)  is  the  power  spec¬ 
trum  of  i  nterdotermi  nate  noise  a  filter  of  characteristic  SM.)  satis¬ 
fying  condition  f  3 .  ~  1 )  is  physical  lv  >-ea  1  i  r.ah  1  e . 
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mav  be  extrapolated  as  far  as  des  i  red .  'hcroforo,  an  ohse,  va  t  i  > m  n  n  time 
F  mav  lie  euui valent  to  an  observation  over  a  longer  tine.  It  is  pussjhip 
to  select  such  an  extrapolation  interval  so  as  to  obtain  a  snr,'i  o  i  cut  I  v 
great  dummy  energy  of  extrapolated  simal  which  provides  for  a  riven  proba- 
bilitv  of  correct  detection  at  a  riven  spectral  noise  Jensitv. 

In  fact,  a  filter  with  a  pi-shaped  'reouenev  characteristic  is  not 
physically  realizable.  This  ideal  filter  cliarac*  eri  st  i  c  mav,  of  course, 
l>e  approached,  *uit  if  is  well  Known  that  the  closer  the  character!  «t  i  c  of 
the  real  filter  is  to  the  ideal,  the  creator  the  simal  delav  that  such  a 
•'liter  has.  In  order  to  observe  the  signal  it  filter  on*  nut  (,or  tire  | 
the  :ignn!  must  1  epp  entering  the  filter  for  a  considers!  iv  lonror  time. 

Ileus,  w'n.at  is  observed  at  filter  output  is  the  result  of  urot  racted  simal 
action  and  therefore  contains  information  .about  a  sjf  f  i  c  i  out  1  v  large  sjmnl 
secret”,  (treat  fidclitv  of  simal  detectii'ti  is  therefore  attained  here 
bemuse  ot'  the  utilization  of  a  large  real,  and  not  dttmnv  simal  ,  and  t  h  i  ^ 
resolves  the  paradox. 

!o  avoid  erroneous  conclusions  wo  will  nowhere  pen:  it  a  limited  spectrum. 


I  See  Sections  and  o.Vi  Ixnansion  of  a  random  process  into  the 

series  represented  hv  formulas  '.d'l  and  others  must  be  understood  in  the 
sense  of  convergence  in  'ht'  me  in  square.  This  moans,  for  example,  'hat  ‘‘or 
the  second  of  formulas  I  i..’1 

K 
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if  expanding  a 
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are  some  rattilo.it,  numher-.  In  the  same  sense  wo  mav  speal  also 
random  ''r'esu  wit1-  limited  spocfrvtm  into  a  f'otel'niley 


';ince  p  i  1 1  j<  i  normal  random  vroccs  -  it  t'ell  -w«  ‘‘run  t  ■  nvergerc, 
it.  the  mean  sunarc  that  convergence  is  almost  contain  !  1  ~  1  ,  i.i  ..  inv  tv.i !  :  - 
■a  t  i  on  n  t>  with  a  probability  of  unify  -av  ’>e  expanded  into  a  1  our  i  or 
ser.es  where  the  coo  *'  *'  i  e  i  ent  s  the  t*xpar.sjon  will  coincide  with  *''c  cor- 
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!he  integration  at'  random  ti  recesses  ,  for  example,  in  formula  t>.~JI  is 
also  umlorstool  in  the  some  ot'  convaavenco  in  the  moan  diii.itr,  ind,  for 
example,  the  integral 


•'Ibis  example  rav  be  compared  with  the  optimum  decision  system  us  inn 
matched  til'ers  figure  a.'>i.  'here,  readout  ot  the  output  voltages  is 
'•acficallv  instantaneous,  but  it  contains  the  neeessarv  information  about 
the  signal  which  was  received  during  the  considerable  lonror  time  '•'. 
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(where  gft)  is  a  regular  function)  represents  a  random  variable  I  such 
that  with  arhitrarv  subdividin'  of  interval  (I'.’P  hy  the  fini  e  set  of 
Points  t,  ■  t,  ■  ...  t(  <  tm+1 

•i 
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where  in  passing  to  the  limit  all  the  intervals  t^+^  -  1 ^  tend  toward  zero. 

Ivory  realization  of  the  intertable  normal  process  n(t)  is  almost  certainly 
integrnhle  and  its  integral  equals  the  cor  respond i iy  realization  of 
variable  I. 


let  us  observe  that  all  results  pertaining  to  interference  resistance' 
coulil  he  more  rigorous lv  derived  without  havinr  recourse  to  series  expan¬ 
sions  of  the  random  prt'cesses,  hut  this  would  lead  to  more  complex  doduc- 
t  ,  vis  and  would  reotiire  matliemat  i  ca  1  apparatus  less  familar  to  enrinei'rs. 

I'iec  Section  ~,~)  !'h«*  optimal  reception  svstens  (decision  svsteirs '  , 

itched  filters,  in  particular,  found  in  this  chapter  are  in  certain  woris, 
.  c .  ,  deduced  h.ised  on  a  statistical  criterion  as  svstems  which  allow 

“:o  deri  vat  i  •>n  of  rite  greatest  ratio  of  i  nstantaneous  signal  strencth  tat 
certain  readout  ’"'rn"  '  to  mean- '.uua  re  i  tit  or  '‘eremv  value.  "’is  approach 
is  en’irelv  iustif’od  in  cases  where  interference  is  normal  tuaussian) 
noise  ird  the  additional  r->uu  i  rement  of  linearitv  is  m.ade  on  tlie  receiving 
svsrem.  In  fact,  the  no-ms!  noise  proh.ahilitv  distribution  i  s  i  opt  durini’ 
passage  throuyh  anv  linear  system,  from  this  it  is  easv  to  deduce  that  of 
all  linear  circuits  the  one  with  the  smallest  error  prohah j ] j t v  is  the  one 
in  wh;ch  there  is  rKe  creates!  s j cna i - t o-ncan-siiua re- j nt e-ferenc-  ratio. 

Proceed  i  in’  m-yly  from  ?>•,.  stipulation  of  maximizi  or  the  siipial-ro- 
noise  ratio,  however,  it  is  i  ir.poss  j  h  |  ,>  to  prove  that  a  linear  system  ilwavs 
provi  les  the  ojtimun.  \ctu.allv,  with  certain  types  of  interference  ( e .  r  .  , 
impulse)  cron  tost  reception  fidelitv  is  found  in  a  nonlinear  system. 
Therefore,  in  deducity  the  decision  principle  from  the  ideal  ot'server 
criterion  and  from  the  struct  ire  of  the  receiving  system  in  con  <’orr  i  t  v  to 
those  >')  irciplfs  w  ncwi'et"  limit  ourselves  to  examinini’  linen-  systems 
alone,  but  loot  f  'r  tbe  oi'ti"'um  with  respect  t<  all  possible  operations  to 
which  the  received  sjc-al  is  subjected.  The  ‘‘act  t'-at  some  of  these  opera¬ 
tions  may  he  performed  in  a  lineir  system  and  coincide  with  operations  maxi 
miziry  the  s  i  j>n.n  1  - 1  (>-no  i  so  ratio  remits  fj-'m  the  pccu  1  i  -ir  i  t  i  es  of  eaussian 
noise  and  mnv  fail  t .  >  'ccur  under  otlier  conditions. 


4.  (‘see  Sections  ,".o  and  o.l)  To  effeet  an  optimal  coherent  decision 
svstem  it  is  ess-ntial,  ronerallv  speak  inr,  to  know  exact  he  and  to  be  aMe 
to  reproduce  all  realizations  of  sicna Is  -i  t  ,  Under  actual  conditions  the 
parameters  of  a  channel  are  never  known  with  absolute  precision  and  there1'' 
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,1  decision  system  contains  a  certain  amount  of  inaccuracy.  Actual  I  v ,  as 
a  consequence  of  this  the  probability  of  error  proves  to  be  greater  than 
that  calculated  for  a  completely  known  signal. 

In  designing  communication  systems  it  is  important  to  evaluate 
tolerances  in  determining  the  parameters  of  received  signals  and  ensure 
observance  of  them.  These  tolerances  cannot  he  stated  in  general  form 
since  they  depend  greatly  on  the  form  of  the  signal.  IVe  will  limit  our¬ 
selves  to  certain  remarks  based  on  the  assumption  that  a  signal  is  a 
narrowband  one,  i.e.,  may  be  written  in  the  form  (.3. -IS): 

C)  /(')>..' [m  p/  ;  T  1  'I'C)| 

The  shape  of  the  envelope  of  lift')  (with  accuracy  to  a  constant  multiplier 
and  ■■tart  of  reading  of  time)  and  also  of  instantaneous  phase  lit)  (with 
aecur.icy  to  start  of  reading  of  time)  is  selected  during  the  design  prove1- 
and  are  reproduced  with  any  degree  of  accuracy.  Thus,  the  problem  amounts 
to  determining  a  constant  multiplier  for  lift),  the  start  of  reading  of 
time,  the  initial  phase  and  the  average  frequency  . 

If  we  use  a  system  with  an  active  delay,  knowledge  of  the  constant 
multiplier  is  not  at  all  required  for  designing  an  optimal  decision  system. 

As  far  as  the  remaining  parameters  of  the  signal  are  concerned,  the  allowable 
inaccuracy  in  determining  them  varies  for  different  systems. 

Tor  example,  we  will  consider  the  effect  of  inaccuracy  in  determining 
the  initial  phase.  For  this  purpose  we  will  assume  that  the  decision  sys¬ 
tem  is  designed  for  receiving  the  signal  of  (3. -IS)  and  in  actuality  the 
signal  which  arrives  is 
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Roughly  speaking,  this  means  that  instead  of  signal  c(t)  there  arrives 
signal  ;(t)cosr't'  and  the  second  term  of  (3.100)  can  be  regarded  as  additional 
interference.  The  effect  of  this  additional  interference,  which  in  the 
first  approximation  is  orthogonal  to  the  useful  signal,  depends  on  what 
other  uscfuT  signals  are  used  in  the  given  system.  If  one  realization  of 
the  signal  is  T(t)  s 1 n [ „  t  +  :  +  :(t),  this  interference  goes  to  certain 

cl  V 

branches  of  the  decision  system  and,  being  added  with  the  noise  component, 
greatly  raises  the  probability  of  error.  Ivon  with  complete  ai  sence  of 
noise,  an  error  occurs  if  •;  -/I. 

In  another  case  when  a  binary  system  with  opposing  signals  is  under 
consideration,  the  second  term  of  (3.100)  generally  has  no  effect  on  the 
decision  system  and  the  inaccuracy  in  phase  1 ;  can  be  compensated  for  by 
an  increase  in  signal  power  (or  the  magnitude  of  tv  1  by  1/co'v  *:  tines. 

If  a  "loss"  in  power  on  the  order  of  10°,  js  considered  permissible,  for  : 
the  tolerance  is  equal  to  IS0. 


I  naccurncv  in  reproduct  i  on  of  tho  average  f  reuuencv 
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first  approximation  loads  to  an  inaccuracv  in  the  initial  phase  inasmuch 

as  an  inaccuracv  in  phase  "runs  after"  a  certain  time  T  =  •.  ’I. 

av 

1'emands  on  accuracy  in  determining  the  instant  of  signal  arrival  or  in¬ 
stant  of  reading  in  a  decision  ,-vstom  can  he  established  similarlv.  T>'o 
accuracy  required  for  coherent  reception  in  maintaining  the  avrai'o  fre¬ 
quency  with  the  present  state  of  the  art  car.  he  provided  onlv  hy  auto¬ 
matic  adjustment  of  it  based  on  the  recei\'ed  signal  itself.  Inasmuch  a« 
the  signal  is  received  together  with  interference,  even  under  these  con¬ 
ditions  the  accuracy  of  establishing  the  frequence  and  phase  of  the  signal 
and  also  the  instant  of  reading  is  limited  and  this  leads  to  an  increase' 
in  the  probability  of  error.  Therefore,  a  preference  is  often  expressed 
for  refraining  entirely  from  determining  the  initial  phase'  and  use'  is 
made  of  noncoherent  methods  of  reception  to  which  the  fn I  lowing  chapter  is 
devoted.  As  will  be  shown  there,  in  noncoherent  reception  the'  tolerances 
in  precision  with  which  the  average  f'reepieney  of  signal  and  instant  of 
reading  are  set  are  great lv  extended. 

.  (See  Section  a.  o')  The  method  set  forth  ror  finding  the  optimal  de¬ 
cision  system  under  conditions  of  normal  noise  with  a  nonuniform  spectrum 
belongs  to  V,  A,  Kotei’nikov  f 1 ] .  However,  in  the  discussion  presented  it 
is  silently  assumed  that  the  time  of  processing  of  a  receive!  signal  is  not 
limited  since  otherwise  complete  "whitening"  of  the  noise  would  bo  impose  j> 

II'  tlie  additional  requirement  is  made  that  processing  of  tip'  «igna!  >'■ 
performed  over  a  time  interval  li’.T'i,  the  statement  of  the  problem  changes, 
The  main  difficult}'  in  seeking  an  optimal  decision  system  according  to  the 
method  described  in  'Section  a..'  is  that  tho  Fourier  coefficients  for 
"colored"  noise  are  "uituallv  correlated.  To  overcome  t  h  i  s  !if'"cu!*\  t'p> 
signals  and  interference  are  expanded  into  an  orthonorma ! i red  svston  of 
functions  which  are  the  eigenfunctions  of  t he  integral  equation 
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where  R!t,s'l  is  a  function  of  noise  correlation. 


Kith,  such  an  expansion  '  he  ci-<*f  fi  eient  s  o''  a  series  for  tv  i:e  prevo  t 
be  independent  random  variables  v  i  t  h  d  i  seers  i  ons  of  •  fl”|.  1'e  will  noirt 

out  that  as  a  consequence  of  the  positive  definiteness  of  t'p  corf' 1  at  i  on 
function,  all  eigenvalues  of  ■  are  not  negati\-e. 

It  has  boon  demonstrated  [l-,1-1'!  thit  the  decision.  rule  w1, :  is  o"- 

timal  according  to  the  criterion  of  maximal  lilelihood  is  that  r.tl  is 

i 

considered  a  received  signal  if  for  all  signals  t  >'o  inoqualitv  r  /  ‘  is  "o! 
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is  the  solution  of  the  integral  equation 
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It  is  easy  to  see  that  for  white  noise  when  Rft,s)  =  1  (t  -  s'i  the 
solution  of  this  equation  is  trivial:  V  (t)  -  c.(tl  -  z^fO  an<l  the  op¬ 
timal  decision  rule  coincides  with  fo.2~1. 

Mi  the  general  case  rule  (.'.102')  can  he  realized  in  the  circuit  of 
figure  o.Ua  if  filter  has  a  transfer  function  gft|,t,')  which  is  a  solu¬ 
tion  to  the  equation 

|  <1  "  1  M  -U  'I  (',  I.) 

II 

and  the  decision  circuit  IV  is  optimal  for  signals  passing  through  -j 

against  a  background  of  white  noise.  It’  the  noise  is  stationary,  i.e., 

R  ( t ,  s )  =  R  (.  1 1  -  sll,  then  filter  :  has  constant  parameters  since 

jUt|,t,1  gft,  -  t  j  1  .  IV' th  a  '!'  that  increases  without  limit  function 

g(t,  -  tji  approaches  the  transfer  function  of  a  "whitening”  filter. 


The  prohah i  1  i  t v  of  error  for  a  binary  system  i  c  determined  hv  the  ex¬ 


press  i  on 
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where 


It  can  he  demonstrated  [S]  that  in  those  cases  when  among  the  eigenvalues 
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a  singular 

event  in  which  a  signal  proportional  to  •  f  si  can  he  detected  with  a  tore 

probability  of  error  since  a  -  ••  .  This  takes  place  when  the  noise  spec¬ 
trum  is  equal  fp  r.ero  over  a  finite  interval  of  rrei,uenc  i  es  as  indicated 
in  Remark  I.  A  potential iv  singular  event  occurs  if  among  the  •.  there 

are  those  as  small  as  <|ps:r>’d.  In  this  case  it  is  possible  to  select  a 
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shape  of  signal  with  which  the  prohahi  1  i  tv  of  error  will  I'e  less  than  anv 
given  value  however  small.  In  actual  channels  wlu  i  the  spectral  density 
of  the  noise  at  any  frequency  exceeds  a  certain  positive  magnitude,  i.e., 
when  the  noise  contains  a  "white"  component,  there  is  no  singularity. 

ti .  Often  devices  which  are  parts  of  a  channel  amount  to  a  circuit  with 
a  transfer  function  l.(:  1  noticeably  changing  the  -diape  of  the  signal.  In 
this  case  we  understand  ’’v  r  1 1 not  the  signal  at  the  input  of  the  channel 
but  a  dist'-^ed  signal  -t  its  output.  Ml  discussion  presented  in  this 
chapter  ho  if  the  eh-nents  of  the  distorted  signal  do  not  cease  in  time, 
otherwise  the  problem  t  reception  becomes  complicated.  '!  h i s  ease  will  he 
considered  more  in  Jet.ul  in  ‘section 

(.See  'section  3.“  1  ormula  ('3.3*11  was  o,'tai'H-d  in-  ‘Shannon  I I  on 

the  assumption  that  a  channel  represents  an  idea!  filter  passing,  signals 
.and  interference  in  a  smictlv  limited  hand  of  freuuoncies  of  width  1  .  It 
is  often  explained  that  this  formula  is  an  approximate  one,  giving  a  more 
accurate  value  for  the  carrying  capacitv  of  the  channel  the  more  pi -shaped 
is  the  frequency  charact er i sr i  .  lor  a  channel  with  an  actual  'Yeuuencv 
characteristic,  formula  13.341  should  determine  the  carrvine  cat'acitv  i  *' 
the  passhand  of  f  is  prep  rlv  determined. 

Mere,  however,  there  occur  certain  difficulties  in  selecting  a  "proper 
determination"  for  the  rassU.ind  which  result  in  i  tuietermi  naev  of  the 
carrying  capacitv  which  is  ''ping  v  Iculatcd.  'or  example,  i  •'  the  channel 
frequency  characteristic  is  Mo  -  ’  >  i  gauss  j. an  curve',  then,  adopting  is 
f’le  value  of  f  the  width  of  this  character  i  s;  ;  ,  at  the  or  ‘Ml  level, 

we  obtain  different  values  for  o  which  v.arv  ><v  a  ‘'actor  of  l.o.  If,  of 
course  the  channel  has  a  frequence  characteristic  which  is  more  rectangular 
the  carrying  capacitv  value  commuted  'enrnds  less  on  the  level  at  which 
the  pass  ha  ad  is  read;  m”'erthe  1  ess ,  (  .•(•••rain  ambiguity  in  determining  the 
carrying  capacitv  still  remain;. 

As  shewn  in  l'1  formula  A .  'Ml  give'-  an  exact  earning  capacitv  value 
for  the  case  where  the  signal  :  have  a  certain  correlation  interval  •  ,  if 

frequenev  1  1  is  understoo.  to  mean  1'  Under  certain  conditions  this 

definition  of  the  frequence  hand  coincides  with  the  channel's  effective 
"noise”  passhand. 

formula  (3.341,  derived  i  a  Section  3.",  expresses  the  exact  channel 
carrying  capacitv  in  which  f  represents  the  conditional  frequency  hand 
occupied  by  the  system  described  i  n  expression  ('•.•11.  It  mav  seem  surnrisin 
that  this  formula  coincides  completelv  with  'shannon's  formula  which  is  de¬ 
rived  under  absolutely'  different  premises.  This  result  is,  however,  en¬ 
tirely  justifiable.  It  is  easy  to  show  that  a  substantial  fraction  of  the 


1  A  multistage  resonant  amplifier  is  In own  to  have  this  rvpe  of  charact eri sf i 


signal  power  spectrum  lies  in  frequence  band  !•'  which  coinciiles  with  the 
"conditional  frequency  hand,"  where  this  fraction  is  lamer,  the  larger 
is  signal  base  21-T.  Without  pausing  to  prove  this  we  refer  to  figure  ^.IS 
which  shows  signal  power  spectra 

>, 

-  p)  \  (..•»>"'  lu',1  i  /•„  ' III  /'til, M 

with  IT  values  of  If  and  2f.  Here  a.  and  h(  are  random  independent  idea- 

K  i> 

rically  distributed  normal  variables.  This  figure  graphically  shows  that 
as  IT  increases  a  larger  and  larger  portion  of  the  signal  power  is  found 
to  be  lumped  in  a  frequency  •wand  of  width  f.  This  permits  formulation 
of  the  theorem  of  the  carrying  cap.acitv  of  a  channel  with  additive  white 
noise  as  follows. 


Fiqure  1 . I f .  5 ional  Power  Spec! rum 

with  Different  ''nines  of  Pose  Tt, 


(liven  a  frequence  hand  of  width  !  and  an  ar^itrarv  uuantitv  . C 


I  here  then  e>ists  a  vaiue  ot’  signal  duration  T,  (det'endent  on  t  and  .1  such 
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that  when  1 

stiucted  where  a  signal  power  of  not  less  than  I'  is  luripel 


f  in  ensemble  of  signals  of  length  ’  and  power  P  nav  he  gen 


ham!  I  ,  and  these  signals  tnav  he  us.-d  te  transmit  informtH 


r  ei  men  c  v 
h  an  arh; 


trarv  small  error  prohahilitv  and  at  i  rate  arhitrarilv  close 
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where  P  is  the  power  of  the  additive  white  noise  in  'sand 


I  rom  this  formulation  it  is  evident  that  Shannon's  'orirula  remains 
valid  no  matter  how  signal  spectrum  hand  width  is  determined.  Stricter  re- 
ipiirements  foy  signal  power  concentration  in  frequenev  hand  1  result  onlv 
in  a  need  to  choose  a  larger  base,  i ,e. ,  in  the  given  case,  in  emplovnont 
of  signal  elements  of  greater  duration,  or,  in  other  words,  in  greater 
enlargement  of  the  source  alphabet  duritv  coiling. 
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CHAPTER  IV 


i  r 


CHANNEL  WITH  RANDOMLY  CHANGING  SIGNAL  PHASE  AND  ADDITIVE 
FLUCTUATION  INTERFERENCE 

4.1.  General  Characterization  of  Channel  with  Randomly  Changing  Initial 
Signal  Phase 

It  was  assumed  in  the  preceding  chapter  that  the  set  of  transmitted 
signals  z.(t)  was  accurately  known  on  reception.  It  was  furthermore  assumed 

that  the  set  of  incoming  signals  ..z.  (r  -  t  )  was  likewise  known  since  the 

1  P 

transmission  factor  ..  and  time  t  taken  hv  the  signal  in  passing  through  the 

P  • 

channel  were  considered  constant. 


Under  actual  conditions  some  parameters  of  the  incoming  signals  are 
unknown  on  reception  and,  at  best,  only  the  probability  distributions  of 
these  parameters  are  known.  At  times  these  unknown  parameter-;  may  he  directly 
determined  to  some  degree  of  accuracy  by  analyzing  the  recei-.ed  signal,  and 
knowledge  of  them  may  be  used  in  receiving  the  following  signal  elements.  I  Lis 
often  proves  to  he  impossible  because  the  unknown  parameters  do  not  remain  con¬ 
stant  during  transmission,  hut  fluctuate  rather  rapidly;  and  knowledge  of 
the  previous  values  of  these  parameters  is  practically  useless  for  receptioi 
of  the  next  part  of  the  signal,  f.ven  in  cases  where  the  unlnown  signal  para 
meters  change  very  slowly  the  opportunity  of  determining  them  by  analysis  of 
the  incoming  signal  is  not  always  exploited.  The  tact  is  that  the  increased 
reception  fidelity  achieved  by  estimating  the  parameters  does  not  always  pay 
for  the  complication  of  the  receiving  unit  which  is  required  to  per  fori:  this 
analysis.  In  many  cases  it  i  >■'  economically  "ore  profitable  to  produce  the 
same  reliability  increase  by  raising  transmitted  signal  power. 

litis  chapter  studies  the  case  where  the  unknown  par. .meter  i*  the  initial 
phase  of  the  harmonic  components  of  the  signal.  Phase  indefiniteness  may  have 
various  causes.  Ihis  indeterminacy  is  provoked  rattier  often  in  modern  commu¬ 
nication  equipment  l>v  the  conditions  under  which  the  ignal  is  formed  in  tin- 
transmitting  unit.  Here  it  is  not  infrequent  that  e'.-'i'v  signal  element  is 
transmitted  with  an  absolutely  arbitrary  initial  phas<-. 


Another  reason  for  incoming 
t i on  m  signal  propagation  time  i 

where  t  changes  within  such  small 


s i gna  1 
in  t It- 

limits 


in  time  At  may  be  completely  disrcgaided. 


phase  indeterminacy  is  the  fluctua- 
ehannel.  Here  the  ease  is  examined 

•'t  that  the  signal  envelope  changes 

Nevertheless,  the  phase  of  the 
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h  i  gh- frequency  fill  t  c*  i  of  the  incoming  signal  changes  within  such  significant 
limits  that  all  phase  shift  values  from  -n  to  *■-  ituiv  he  considered  equipru- 
bable.  for  this  the  condition  must  be  fulfilled  that 

)  .  M-n 

a  v 

where  f  is  the  average  frequency  of  the  signal  spectrum  and  !■  is  the  condi 

tional  frequency  band  occupied  by  the  signal. 

It  is  apparent  that  condition  (-1.1)  may  be  fulfilled  only  for  relative  1 
nar  ri  w  band  s  gnals  in  which  !  1^,  but  it  is  i  us  t  these  signals  which  are 

ordii.irily  used  in  radio  communications  and  in  long-range  wire  communication. 

he  will  show  that  under  cotulitt  mi  (1.1  I  propagation  time  f luetuat i one 
may  be  reduced  te  phase  fluctuations,  let  the  signal  be  transmitted 

.'(''i  \  lit* O' •>'■•••, ,*  *  hk\' n  bii  ;i  ^  r » c< m •• hi ,/  ;  r*i,  ( •! .  J  i 

<■,  *  * 

whe  re 

"•  I  '  r* 

.he  incoming  signal  in  union  with  the  interference  is 


!  10  ■:  1  ••  (  ’  /,  I  :  r»  :  ;»!  ;  'MU. 


i  ' , 


where  ..  i  ;  a  constant  transmis  i  mi  factor,  t  .  average  propagat  l  time; 
ii  i  t  1  ,  additive  interference;  aid 
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difference  between  them  dues  not  exceed  M  I 


I  h  .  jiermi  t  s  t  he  i  n  1  ta¬ 


ut'  :  tor  all  h  to  he  considered  approximately  i  dent  i  cm  1  and  equal  to 

t  . 
av  p 

The  fluctuations  in  n ropaga t  i on  t  i tat-  t  iikiv  in'  caused  l"’  changes'  in  file 

P 

medium  in  which  the  radio  signals  are  being  propagated  (.e.g.,  .  h.inges  m  the 
height  of  the  reflecting  region  in  ionospheric  communication,  changes  in  cable 
and  amplifier  temperature  in  wire  communication,  etc.),  and  also  given  by 
changes  in  the  mutual  arrangement  of  t  r.uismi  1 1  e  r  and  receiver. 

1  lie  condition-,  for  receiving  signals  depend  ti  a  con-;  i  de  rail 1  e  degree 
mi  tlu'  rapidity  with,  which  the  f  luctuat  ions  occur. 

1‘he  following  cases  may  be  distinguished: 

1)  very  rapid  fluctuations  where  signal  phasi  changes  suhst ant i a  I  ly  over 
a  single  signal  element; 

2 !  rapid  f juctuat i ons  where  tie  initial  phases  of  adjacent  signal  elements 
nay  be  considered  uncor  re  1  at  ed ,  but  which  do  not  i.-r.eptihly  change  within  one 
element  of  the  signal  phase  (phase  f  1  net  uat  i  >.  :i  s  caused  by  s  i  gna  1  -  simp  i  r g  ren¬ 
ditions  witiiin  the  transmitter  also  usual  lv  bebr.g  to  this  casei; 


aj  slow  fluctuations  where  the  initi  tl  phases  of  au;  a  :e:it  elements  are  a! 
most  identical,  but  the  phase  change-  cr- i  J-.  :  al  ly  u-r  several  el*  ment  -• 

-1)  very  slow  f  luctuat  ions  where  signal  pliasi-  changes  little  e.er  a  -substan¬ 
tial  niiinber  of  signal  elements. 

This  c  1  ass  i  f  i  cat  i  on  is,  of  course,  ir'-i  t  r  ir-  .c.d  ‘is-re  art  v.r;  "is  :n- 
tertteui  at  e  ui^'s  .  It  is  useful,  howev*'  r ,  a «  .  c*rtai;-  .r  -traifiir  *  o  ’  t  ■  ... 
fate  theorct i ca 1  analysis. 

The  first  case  is  usually  a.  comp  anted  I  just  as  r.,p  i  d  .'  i :  ’  i  .>  t  i  o:"- 
the  tru.sfer  coeff  i  cieitt  ,b\  -ignai  ftl.ngi  and  will  V  at.  dJcu  i  ■ 

Chapter  '.II.  I  he  1  ..rti.  a-"  differ;  almost  ;•>  '  .<•  all  from  '!■  c  a  -  ■'  t 
completely  known  signa.  as  .ii  •'.•us-od  in  -ii.pfer  ill.  iri-riuh  a-  wi:  '  !a.  r* 

ire  "iv  slow  f  met  uat  ions  in  phast  it  is  puss  it*  by  an  ilv<is  t  :-■•  i  i  ng 

signal  elements  to  determine  :  t  h  <uf  f  i  c  i  enl  ..  uraci  tile  •  -  >;  j  ph  ise 

relationships  i  r  the  sub  ;eque:.  *  e  i  rw-  ■  i :  t  •••  an.:  to  effect  cohei  ■  l.t  rece; 

.'•or  the  Second  case  complete  absence  of  i  a  t  k.n:  at  i  ■"  a;  .-at  *  i  ■  :nit  i. 
phase  of  the  received  signal  element  is  fir.i'to  o'..,  As  will  --i  saowu  ;  at  e 
this  does  not  hinder  reception  of  the  i  n  i'o  rmat  i  on  contained  a:  the  element 
if  only  it  is  not  contained  in  the  value  itself  f  tl  e  initial  T.-cu  .  lbs- 
crimination  of  a  signal  in  the  complete  .ibsmie  f  (p.-r  \i'.h  tin  .vn;  b  '.<■ 
failure  to  usej  infonnatiun  aiiout  the  luiti  il  phase  f  ea  1:  e !  i-:»'  t  » ;  ‘  I  1  <• 
called  absolutely  incoherent  cecept  i on . 


-  I 1 


in  : 1  .:.i  v  ,jm  «  >.  v  up  i  i*s  hi  i  nt  r  rr\cil i  .1 1 1-  j  os  i  t  i  on  between  the  second  anil 
toil  I  •  \s  iii  tin-  tourth  i.im  loherent  reo'i  timi  is  in  principle  possible  but 
lor  e\  .i  lu.it  i  on  ot  tin-  ini?  .i  1  ph.«se  ot  .i  signal  element  only  a  small  number  of 
pii  oiling  r  1  rir.fiit  s  ray  bo  used  am!  this  loads  to  significant  error  a  ml  to  an 
nureaso  in  tho  probability  ot  error.  In  the  third  case,  .is  in  the  fourth, 
understandably,  it  is  possible  to  employ  absolutely  incoherent  reception  by 
refraining  from  tho  i.«i  of  any  information  about  the  initial  phase  of  tho  e.\- 
pocted  signal  element.  However,  use  is  made  here  of  relatively  incoherent 
reception  in  which  the  initial  phase  of  a  certain  sequence  of  elements  is  un- 
in  own  ,  but  possible  phase  relations  among  adjacent  signal  elements  are  known. 

I*. 2.  Conjugate  Signals,  Envelope,  I  ns  tan t aneous  Phase,  and  Instantaneous 
Frequency.  Orthogonality  in  the  Intensified  Sense. 

In  our  study  of  incoherent  reception  we  need  such  concepts  ns  signal  en¬ 
velope,  its  instantaneous  phase,  and  its  instantaneous  frequency.  These  con¬ 
cepts  arc  rather  widely  used  in  engineering  practice  but  they  are  not  always 
unambiguously  understood.  In  this  paragraph  we  give  definitions  which  will  be 
used  in  this  and  subsequent  chapters.  Although  those  definitions  are  not  the 
most  general,  they  are  convenient  in  the  mathematical  model  uf  signal  and 
interference  used  here  and  arc  adequate  for  solving  the  problems  presented. 
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I  he  represented  in  this  interval  by  the  series  (3.2): 
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where  =  2r/T. 

let’s  assume  that  all  harmonic  components  of  this  signal  are  shifted 
in  phase  by  a  certain  magnitude  ..  As  a  result,  we  obtain  the  signal 
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IV  i'  will  note  that  Hit.'  condition  ol  01  thogunal  1  ty  in  an  i  nt  ciis  1 1  1  oil 
sense  can  he  written  lining  analytical  signals: 
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j  Zl(u'£’lu),H  0.  (d.l Sa  i 

where  c  t  ( t  )  -  c  (t  |  -  i  c.ft'  is  a  funct  ion  complex  conjugate  with  I,(t). 

A  system  1'  in  signals  is  called  orthogonal  in  .m  intensified  sense  ;l 
condition  f-l.lS)  holds  for  any  pair  of  signals. 

^.3-  Decision  System  in  the  Cose  of  Absolutely  Incoherent  Reception 

Rased  on  the  criterion  of  maximal  likol.hood,  we  will  find  the  optima! 
division  principle  in  the  ease  of  reception  of  a  single  signal  element 
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inequality  (4.JS).  They  are  compared  with  one  another  and  tin-  rrcatos*  si! 
tlu’tn  determines  that  one  of  the  possible  symbols  wh  i  eh  in:  1  s  t  he  selected  In 
the  decision  system.  The  .  ystem  shown  in  ligure  1.1  is  called  a  quadrat u r 
s  v  s  t  era . 
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Figure  .  1  .  Deci  ion  System  For  a  Signal  i  th  ,e 
Indeterminate  Phase:  A,  Multiplier;  B,  Loca I  sigril 
generator;  V,  90°  phase  inverter;  G,  Integrator; 

K,  Device  with  a  quadrature  characteristic;  D,  So- - 
mator;  E,  Nonlinear  device;  Zh ,  Computer. 


The  decision  principle  obtained  (l.dSaj  can  he  greatly  imp! i tied  t  or 
systems  with  an  active  delay  when  the  powers  of  all  variants  .q  t!io  •-  i  >..n  ;i  1 
are  the  same.  In  1 1  ght  of  the  fact  that  with  all  \  0  t  lie  ftrofien 

logl  fxj  is  monotoni  cal  ly  increasing,  t.he  decision  princi,  le  v  a:  formu¬ 

lated  as  follows:  an  ideal  receiver  or  system  with  m  i e* t  i  •  ini'  rv  il  and 
with  an  indeterminate  phase  of  signal  must  register  tie.  -  vmi>  >  ;!  ter 


For  all  systems  with  an  active  interval  the  quadiatun  o-tv::  i  -  greitlv 
simplitied  (Figure  1 . 2 )  .  In  this  ease  nonlinear  devices  I  and  >uhi  i  ...Ting 
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System  with  Matched  Filters 

Besides  the  quadrature  reception  systems  there  are  other  possible 
ones  which  permit  reception  in  accord  with  principle  (-I.Z8)  or  N . 30  )  .  These 
systems  may  tie  based  on  matched  filters  [3,-lj. 

As  was  shown  in  Chapter  111,  filter  matched  to  signal  r.it  has  the 
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Loop . 

Fy  achieving  a  h  i  i;!i  n  faster  in  a  loop,  it  i  -.  possible  to  a.-p  r-sivl; 
ideal  vase  shown  in  Figure  l.t.  We  will  note  that  damping  os  illations  pe 
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served  in  a  loop  with  a  high,  ii- factor. 
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A  similar  problem  ot  optimal  incoherent  detect  ion  of  .1  -inusoiJ.il  signal  1: 
white  noise  has  heen  studied  1  n  detail  m  radar  theon.  However,  in  \  iew  ot 
the  important  differenee  in  the  cost  ot  error  t  false  alar"  or  ••  1 1  n,);  .1  Mpna 
use  is  usual lv  made  in  radar  of  the  '.e  1  van- 1'e  arson  eriterion.  Here,  in  .itvor 
dance  with  pecu 1 1 ar 1 t 1 es  ;  f  a  system  tor  transmitting  discrete  messages,  u<e 
is  made  of'  the  maximal  likelihood  criterion  which  coincides  in  the  c.-ee  of 
the  same  a  priori  probabilities  of  a  signal  with  the  ideal  observer  criterion 
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I'h  i  s  inequality  d  i  tiers  from  ( -1 . ..  (da  I  in  thal  the  expression  on  the  riyht 
side  depends  not  only  on  ..a,  but  also  on  • 

i  he  re  fore  with  a  weak  signal  tin  optimum  operating  threshold  is  deter- 
mined  i  ot  only  by  the  amplitude  of  the  ineominit  sipnal.  luit  also  by  the 
intert’-.  renee  level.  Let  us  denote  the  optimtu;  operating  threshold  by 

-  .,  Variable  -  1  *  we  will  then  call  the  optimum  relatke  operating 

t  !t  neslu)  1  d  .  litpare  I.!!  shows  the  relationship  in  tween  li  and  this  threshold. 
Kith  larger  values  of  ii  it  ttnds  toward  b  a  ,  whirl,  ayn-es  wit!  ( -1 .  hOa  '•  . 

l\e  will  determine  the  error  u  rohabi  !  1 1  i  es  bv  su!  -'.tutine  .  t  t  J 
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as  the  integration  limits  n<  expression  ( -1 ...  1  I  and  (l.oJi: 
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Figure  ^.12.  Dependence  of  Error  Pro¬ 
bability  on  h  i  n  an  Amplitude  Keying 
Sys  tern . 

Honorthogona I  Systems  with  an  Active  Interval 

Calculation  of  error  probability  in  the  case  when  the  conditions  of 
■  1.1SJ  are  not  met  can  he  performed  in  the  same  way  as  in  the  preceding 
examples.  However,  great  difficulty  arises  here  in  computing  the  joint  den¬ 
sity  of  V  since  X^,  V  ,  X,  and  V;  are  not  indepen  lent. 

We  will  first  consider  a  binary  system  witn  an  active  delay  and  assume 
that  signal  :  (t)  was  transmitted  and  the  initial  phase  had  a  value  of  .. 

io  compute  the  error  probability  with  optimal  incoherent  reception  it  is 
necessary  to  find  the  probability  distribution  density  of  the  variables  X ^ , 

V  j  .  X,,  and  V,  and  integrate  it  over  the  area  for  which 

•v,  ;  >  ;<  -v  •  »■;. 

Obviously,  in  this  case  the  distribution  of  X  and  V  is  normal.  We  will 
compute  their  moments: 
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We  will  note  that  a  Bunyahovsk  iy-Shwart ;  inequality  yields  the  following  ex¬ 
pression 
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(4 . 5>~h  i 


The  variable  c  characterises  the  degree  of  deviation  Cron:  orthogona 1 i tv  inns 
much  as  when  -  0  the  signals  are  orthogonal  in  an  intensified  sense  and 
when  c  =  1  they  coincide  with  an  accuracy  to  the  initial  phase. 

As  in  C 4 . 4 1 j  we  obtain  for  the  second  moments 
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Obviously,  for  Xn,  A^,  and  Ah,  the  value  of  dispersion  is  given  by  expression 
(4.41),  It  is  further  easy  to  see  that 
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figure  4.13  shows  the*  dependence  of  error  probability  on  h“  for  v  ;i  r  i  <  *  j  v 
values  of  .  .  As  is  apparent  from  this  figure,  the  most  resistant  to  inter¬ 
ference  is  the  orthogonal  system  (.  =0).  With  an  increase  in  from  0  ti  o.l, 
the  probability  of  error  increases  relatively  little  and  the  deviation  from 
orthogonal i tv  may  be  compensated  for  by  a  slight  increase  in  the  power  of  t'a 
signal.  This  is  even  more  clearly  demons  t  rat  ed  m  I  igure  l.l-l  which  show*-  :  be 
dependence  of  the  required  value  of  lr  on  ,  with  a  given  probability  of  ei  :  ■  r. 
When  ,  approaches  unity,  the  signals  become  indistinguishable  (with  incohe**:it 
reception  and  no  increase  in  power  will  compensate  for  the  drop  in  fidelity 


We  will  note  that  variable  .  lias  a  simple  physical  meaning.  The  reader 
can  easily  see  that  it  is  equal  to  the  ratio  between  the  envelope  in  a  filrv 
matched  with  :,(tj  and  the  envelope  m  a  filter  matched  with  Cj(,tl  at  the  in 

stant  of  reading  if  signal  r.j(t)  is  delivered  to  them  without  'interference  . 

for  systems  with  a  code  base  of  m  •  2  and  nonorthogonal  signals  it  is 
not  possible  to  obtain  with  reasonable  simplicity  general  expressions  for  tie 
probability  of  error  in  the  case  of  optimal  incoherent  reception.  However, 
for  some  particular  cases  it  is  possible  to  obtain  exact  solutions  for  .it 
least  evaluations  by  using  more  or  less  artificial  procedures.  Here,  as  in 
the  -use  if  coherent  reception,  it  is  sometimes  possible  to  reduce  the  proHen. 
to  i  more  sin. pie  one  by  using  the  isomorphism  of  systims.  However,  in  the 
v  isr  i.if  incoherent  reception  equality  of  f.otelnikov  distances  is  not  sufficient 
tor  i  son.orphi  sm  of  -vstems.  It  is  further  necessary  that  this  equality  be 
re  *  a i re d  with  change  -  in  the  initial  phases  of  signals.  I  he  possibility  of 
renuril  or.  ng  the  'ign.il*-  so  as  to  meet  the  following  equalities  is  a  suflieient 
■  -udi  1 1  *  i.  tor  two  -y  it*"  ,  to  be  isomorphic: 
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.v  express,-,!  by  foitnu.'a  l.-li*  .  lUit  tillers  like  this  are  difficult  to  re- 
ilice.  Iherefore  simpler  filters  are  uscl,  for  example,  t'iltir  in  the  torr, 
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.imp  1  i  tude  ol  a  .it  its  input,  and  on  I  ,  and  also  noise  of  normal  probahi- 
litv  distribution  and  intensity  dependent  on  '  f.  The  envelope  of  the  total 
voltage,  as  is  known  [bj  ,  has  a  generalized  Rayleigh  probability  distribution 
just  as  in  the  case  of  a  matched  filter.  At  the  output  of  a  matched  filter, 
however,  the  ratio  of  signal  power  to  noise  power  at  the  moment  of  readout  is 

,rr  >r.i  .. 

h  , 

while  witn  nonoptieal  filters  it  depends  on  the  ratio  between  effective  pass- 
band  f  and  signal  duration  T,  By  varying  the  value  of  A f  we  can  find  the 
value  of  it  at  which  the  signal  power  to  noise  power  ratio  <r  at  readout  moment 
is  maximum. 

With  reception  of  a  single  pulse  this  passband  for  a  single  resonant 
loop  is  equal  to  f  -  C.ba/T  .and  for  a  pi-response  filter  f  -  l.o~/T  [b,9j. 

With  the  effective  filter  passband  thus  selected  the  maximal  value  of  cp 
is  19]: 

t/-  -  ii.si.a  f’  1  ".Sl'dr  for  a  resonant  loop, 

^  I'.Bdrdi"  ‘‘or  a  pi-response  filter. 

If  the  voltage  across  a  filter,  not  tuned  to  the  frequency  of  the  re- 
.oi\ed  signal,  were  determined  only  by  fluctuation  interference,  decision 
making  in  this  syst-  .  would  reduce  tu  comparing  the  values  of  the  two  enve¬ 
lopes  at  the  moment  of  readout,  and  one  of  then  (in  the  filter  without  the 
signal]  would  have  a  Rayleigh  distribution,  while  the  other  i  n.  the  filter  with 
the  sjgnali  would  hive  a  generalized  Rayleigh  probability  distribution.  Re¬ 
seating  the  same  calculations  as  in  conclusion  td  .dpi  the  error  probability 

l  _  ■  i 

P  ,  '■  *' 

vould  be  found,  i.e.,  it  is  the  same  as  in  the  optimum  system  it'  signal  power 
s  ds .  ;i  n  i  slied  i  S'.  . 

Ihere  is,  however,  no  bast  tor  this  eenc  ius  i  er. .  he  must  take  into 
t. -count  ,  first,  that  with  unmatched  filter--  the  received  signal  at  moment  of 
readout  creates  a  voltage  both  in  the  filter  tuned  to  its  frequency  and  in 
tin  'ther  i  re.1  Second.,  .it  the"  moment  of  readout  residual  colt  ages  fruit,  tran- 
-  :  •  •  i t  processes  c rented  by  the  preceding  signal  <  lements  are  kept  at  the  outputs 

Ih.is  phenomenon,  despite  t  lie  existing  fa  1 1  acy  ,  does  occur  in  ideal  pi  -  rest'otis. 
t  liters  with  nonoverlapping  hands,  Mine  at  readout  moment  they  do  not  yet 
have  tin  steady  state  in  which  a  ; ignal  outside  the  passband  does  not  traverse 
•  he  filter.  « > n 1 y  in  unmatched  filters  and  orthogonal  signals  is  the  voltage 
at  readout  moment  at  the  output  of  the  "empty”  filter  determined  hv  inter¬ 
ference  alone. 


ii  inis  case  is  comp  I  i  i.il  -d  !>  the  tut  th.it  q  and  will  d'-pe.nd  m,  wi.it 
signal  '.‘lenient  niece. led  the  <>ne  under  eons  i  tie  ra  t  i  on  . 


In  all  actual  systems  fi Iters  are  used  in  which  a  s toady  state  d  es¬ 
tablished  by  the  moment  of  rending  and  the  signal  is  practically  not  weiikemd. 
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I  lie  authors  of  ..or!  [  i  J  J  show  that  ‘  •  .  apprent  ly  is  an  opt  i mil  value 
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i.e.,  this  rece  i  \'  i :  i  jt  method  is  equivalent  to  s  i  n.i  1  pou<  r  lo^s  hv  .1  lactor  .  : 
'.rr  as  compared  to  optimum  ivcept  i  ■  >n  . 

I  ho  no  i  so- res  1  s  t  ance  of  u  i  de-band  reception  ray.  however,  ho  Mil"-l.iii- 
ti.allv  inoroasod  it-  a  decision  is  made  not  on  t  ho  h.isis  o!'  t  !io  i  nst  ant  am  oit- 
vaiuos  of  tho  onvolopo,  but  their  whole  sour  •  throughout  duration  I  .  I'  a 
signal  element  is  taken  into  account .  hot  us  observe  that  in  narrow  -bind  ;e 
cep t.  ion  our  taking  into  account  tho  values  of  the  onvolopo  at  different  re 
isients  in  time  throughout  a  single  element  cannot  increase  noi  so  -  res  i  s  t  an  ce 
hecause  all  these  \  allies  are  h.iglily  i  ntercor  re  1  at  ed  and  therefore  contain  in 
additional  1 1. format  i  on .  in  the  wide-hand  filter  the  correlation  internal  [ej 


whore  R(-'  is  the  envelope  o-'  the  correlation  coefficient  of  the  noise  passed 
through  tho  filter,  is  si  gni  fi  cant  ly  less  than  1.  'I  here  fore  there  appears 
a  possibility  of  increasing  noi  se-ivsi  stance  by  t  tiling  ;nto  account  the  wh  do 
course  of  the  envelope. 

Let  us  .assume  that  a  decision  is  made  from  taking  into  account  !  he  ■.  o  1  - 

tage  envelopes  at  the  filter  outputs  at  moments  in  time  divisible  by  1'2‘f. 

Let  us  suppose  as  a  first  app  ru.x  i  mat  i  on  that  the  noise  values  separated  by 

interval  •  are  mutual Iv  uncorre I ated . '  Let  us  denote  these  values  for  the 
c 

first  filter  by  Xj,x,,...,x  and  for  the  second,  by  y  ^  ,y ,y^ ,  where 

n  -  2,fT.  I.et  us  find  the  optimum  decision  principle  (based  on  the  ideal  ob¬ 
server  criterion.)  which  is  realizable  with  respect  to  these  values. 

’if  there  were  an  ideal  pi -response  filter  these  values  at  its  output  would 
be  strictly  uncorrelated  among  themselves  (and  hence  also  independent  for 
gauss i an  noi sej . 
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in  practice  i  low  -  'ivuueno  t  i  1 '  <  i  wh:  it.  i  -  no’ 

.s.i\  ml-..  i'  often  u  >ed  instead  nl  the  :  ;:ti  r .  >  t  rr  .it 

■.  i :  it  l  i  !(•.■!'  iHiti'ii!  u.ll  !  e  riot  or*  :  n.i  1  ,  :n •  ?  1 1 

•  'ii', .tiio  1  1  >  i  ii  1 1’,; r.i  i 

II  (.'  I  J  |/  .  / !  :■  I  .  '..Of. 

whole  g  •  is  tl'.i  low  - 1  roquor.cy  t  i  1  ter  ;  ;!m>  r*  spoils*  . 

li.i.t  t  :i  t  4  r.i  l  1 1  ;■  resun  i  •  a  r  indo::,  \ .  i  r :  : • ;  ■  *v  h .  •  - .  •  •  name  i  i  .  a  1  dn:,i  ’  - 

••  ,.\  ''c  .onputed  it'  git;  ;s  1  nowi: .  1;  g  , :  .  1 :  t  t  c  :  >  little  :  rot.:  '  ’vs<  i  ■  r, 

1.-'  ,  tit'n  tin.'  iSf  -  res  i  •;  t  ar.ce  of  tins  re  ..up’ ion  me  t  he  >ti  will  a  1  s  •  apj  ’’one:. 

i.'ji  rt'S  ist  muf  >f  ivcopt  i  "ii  u  t  ti.  r  -  . ! ■  1 1 ■ . ■  t  i  ei  i  nt  eg  rar  i<  n  .  !• ; : ;  : :  • 

:\l .  n.it’i  !y  um'J,  relatively  <  i  :::]•  !e  !  ew  t  ruqiii-ncy  t’i  Iters  have  nr.  impuls* 
pense  which  lifters  from  ti'ni  at  aiiv  value  of  t.  Hi  i  s  has  .  i  -  its  rosi.lt 
tit. at  filter  outpi:  \oltag"  at  the  •■nt  a  tv  a. lout  il*  'pend  s  both  >:i  the  ri¬ 
ce  i  v  ed  signal  >.•  1  •.•Mont  and  on  tliv  .  i  i : .  1  i  *  •?:.  tilts  a  i  u,e.  iui  to  the 

uay  this  occurs  at  a  h  i  gh  -  f  rviiuuiti.  \  ti  it’-:  output  i:  trio  narrou  hand  t  tivo  ’  op* 
ro  v  up L  1 1 n:  s ys  t  or. . 

this  plionor.oiio;:  - ubst ant  i  a  I  1  v  in, lenses  erroi  rrobabi  !  i  t>  .slid  t  •>  •  o'’.ha‘ 

it  ro  1  at  i  vo  ly  b  road  passband  tilt  ors  .  :  :  uliiJ:  response  git1  is  adequat  o  ly 

damped  by  tiitio  t  I  ,  should  bo  used.  Ivsu 1 t ant  1\  ,  variablo  y  i  1  -  l  in  i  n 
tegral  [-t.i'bj  prov-w.  to  bo  cons  i  do  rab  1>  lus-.  than  unity  :  n  a  s  i  gn  i  fi  .  an :  por- 
t  i  on  ot"  its  integration  range  ;  this  loads  ti  “incomplete  i  nt  egra*  i  •  rd*  of  tin 
iumso,  i.o.,  to  reducing  the  ratio  ot'  tin  constant  component  to  t  ho  t'hutua 
tiul.  component  of  the  voltages  at  the  output  of  the  t'ilter  which  appears 
behind  function  symbol  1  (in  express  ie  n  I.'JI). 

Numerous  computations  [9]  show  that  for  the  different  low -frequency 
filter  characteristics  the  best  compromise  between  the  conditions  of  o'  tailing 
insufficiently  small  residual  voltages  from  preceding  signal  elements  and 
the  host  noise  average  is  made  when  the  effective  1 ov - frequency  filter 
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order  to  stress  that  a  discrete  channel  with  relative  phase  keying  is  a 
channel  with  a  memory  in  which  errors  have  a  tendency  to  group  in  twos.  This 
must  be  taken  into  consideration  in  coding. 


Figure  ^.26.  Probability  of  Error  for  a 
Binary  RPT  System. 

It  should  not  be  thought  that  all  errors  in  a  received  sequence  of 
symbols  are  joined  in  pairs.  In  coherent  reception  single  (isolated)  errors 
may  appear  when  interference  destroys  two  or  several  elements  of  a  signal  in 
a  row.  In  this  case  two  isolated  errors  appear  at  the  beginning  and  end  of  a 
group  of  elements  with  incorrectly  determined  polarity.  Thus,  the  proba¬ 
bility  that  in  a  PT  system  there  will  be  not  less  than  two  incorrectly  re¬ 
ceived  symbols  between  two  correctly  received  symbols.  In  light  of  the  fact 
that  in  RPT  interference  in  the  form  of  white  noise  creates  independent 
errors,  we  have 

/>,,  '-’il  :  i'l  y' 

-||  /y.i'y  11  /'■>.  /Vi  :  1  -;l  /V I 

or,  in  light  of  ( 4  .  *>!>  j  , 
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fhus ,  in  a  channel  of  good  quality  when  Pj,  ••  1  ,  isolated  errors  in  co¬ 
herent  RPT  reception  constitute  an  insignificant  part  of  all  errors.  lo  them 
must  be  added  those  isolated  errors  which  occur  during  spontaneous  skips  in 
phase  of  the  reference  voltage. 


Altogether  different  relationships  are  found  whin  reception  is  incoheren 
Id  this  case  there  is  also  a  tendency  for  errors  to  group  themselves  in  pairs 
and  this  is  caused  by  the  fact  that  the  intervals  of  tire  which  ai"  used  for 
reaching  two  sequential  decisions  partially  overlap.  However,  isolated  errors 
s'ill  constitute  a  significant  proportion  of  all  errors. 


Hie  evaluations  obtained  in  [  2  4  J  show  that  when  p  |.  '  4  -  It)  *  i'rom 

31.2  to  75.o"i  of  all  errors  are  isolated  and  when  p^,.|.  *  3.0-10  i'rom 

37.2l'u  to  78.o'I>.  We  will  note  that  in  a  channel  with  independent  errors  prac¬ 
tically  all  errors  are  isolated  when  the  average  fidelity  is  the  same. 

As  a  consequence  of  error  grouping  in  KPT,  there  is  no  point  in  direct 
application  of  codes  which  correct  single  errors.  Fidelity  can  be  •  increased 
here  by  using  Abramson  codes  which  were  mentioned  in  Section  2.8.  These  codes 
permit  correcting  single  as  well  as  double  adjacent  errors.  It  is  also  pos¬ 
sible  to  use  codes  which  are  intended  for  the  purpose  of  correcting  independent 
errors  in  introducing  decorrelation.  In  the  given  case  this  is  done  In- 
joining  odd  and  even  (in  order  of  occurrence)  symbols  in  a  combination  of  :■ 
correcting  code.  When  using  a  recurrent  code  decorrelation  is  a . comp  1 i she!  if 
the  step  of  the  code  is  equal  to  two  or  more. 

RPT  Systems  When  m  >  2 

Along  with  binary  KPT  systems,  rather  wide  use  is  made  of  RPT  systems 
whose  code  base  is  m>  2  (most  frequently  m  =  4  and  m  =  8).  Usually  such 
systems  provide  for  multiplexing  of  a  channel,  i.e.,  simultaneous  transmission 
of  messages  from  several  sources  and  several  (most  frequently  two  or  three) 
binary  channels  are  considered  to  be  an  aggregate.  We  will  talk  about  them 
from  these  positions  in  Chapter  IX,  determining  the  probability  of  incorrect 
reception  of  a  binary  symbol  in  each  of  the  aggregate  messages.  However,  in 
the  past  few  years  increasingly  greater  importance  has  lu-cn  acquired  by  use 
of  symbols  with  a  larger  code  base  for  suitable  transmission  of  coded  data  fi  *r. 
one  source.  In  this  respect  the  probability  of  correct  or  incorrect  recep¬ 
tion  of  the  n-th  symbol  is  of  interest. 

By  way  of  example  we  will  consider  the  case  where  m  =  4.  Let  there  he 
transmitted  symbols  0,  1,2,  and  3  and  let  information  about  them  be  embedded 
in  the  difference  between  ph  is<  .  between  adjacent  sirusou.nl  signal  elements. 
For  example,  ‘  ;  =  0  correspond  to  symbol  "0",  =  ~/l  to  symbol  "]’  , 

:  =  -  to  symbol  "2",  and  :  =  3  /2  to  symbol  "3".  Thus,  each  signal  element 
has  the  form 

I  I*  *  (l  ('  S  f  U»/  's  •  V  f  ^  t 

\  1  1  J 

where  .  is  the  initial  phase  and  coefficient  k  assumes  the  values  of  0,  1,  2, 
and  3,  depending  on  the  transmitted  symbol  and  the  phase  of  the  preceding 
element . 

If  the  initial  phase  .  fluctuates  so  slowly  that  it  can  he  considered 
known,  quas i -coherent  reception,  such  as  in  a  PT  system  with  m  =  4  with  sub¬ 
sequent  recoding,  is  possible.  The  rules  for  this  are  obvious.  The  proba¬ 
bility  of  correct  reception  for  such  a  14  orthogonal  PT  system  was  computed  in 
Chapter  III  (3.7Uaj.  Hence,  the  'error  probability  is 


-248- 


'?nr.TrT»n,Tm 


1  ■  . . . . 


I  I  .'I  I  |!  ■!' i/«i]  •  H.10KJ 

1  |  (I  'I  ,/;■:••  illilM 

lo  compute  the  probability  of  error  in  a  KPT  system  it  is  necessary  to 
consider  the  doubling  of  them.  However,  this  is  not  as  simple  as  it  was  in 
reaching  the  conclusion  of  (4.99)  inasmuch  as  two  adjacent  errors  in  a  Pi 
system  will  lead  sometimes  to  two  and  sometimes  to  three  errors  after  recoding 
to  KPT.  Therefore,  we  will  limit  ourselves  to  obtaining  an  evaluation  from 
above,  bearing  in  mind  that  an  error  in  recoding  never  leads  to  more  than  two 
errors  after  recoding.  Consequently, 


/Vp,i  -Ml  ‘I’ i >i i]  J  j|  , !,,/„!  (4.109) 

When  h  •  1  and  when  the  occurrence  of  adjacent  errors  prior  to  recoding  is  ex¬ 
ceedingly  small,  this  evaluation  is  a  good  approximation.  Ignoring  under 
these  conditions  the  square  of  the  small  value  1  -  1(h),  we  obtain 

/Vp>  '-'I1  'I'-H  I).  (4 .  1 09a ) 

i.e.,  the  probability  of  error  is  four  times  greater  than  in  a  binary  system 
with  orthogonal  signals  in  the  case  of  coherent  reception. 

In  case  of  incoherent  reception  the  initial  phase  .  is  considered  to  be 
unknown.  The  transmitted  signal  is  determined  by  a  segment  of  the  signal 
joining  two  elements,  namely: 

The  following  signal  corresponds  to  symbol  "0" 
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An  optimum  incoherent  decision  circuit  for  such  a  system  can  be  made  in 
various  ways.  Spec i f i cu 1 ly ,  general-purpose  circuits  are  possible,  i.e.,  a 
quadrature  one  and  one  with  matched  filters.  They  differ  from  figures  4.21 
and  4.23  only  in  the  doubling  of  the  number  of  branches  and  the  replacement 
of  a  final  subtracter  with  a  circuit  for  comparing  the  four  magnitudes.  Other 
variation  will,  be  considered  in  fhupter  IX. 

for  an  evaluation  of  error  probability  with  optimal  incoherent  reception 
we  make  use  of  the  fact  that  the  system  in  (4.110)  is  isomorphic  with  system 
(4.o3a)  if  in  the  latter  the  signals  are  delivered  not  in  the  interval  (0,  T) 
hut  in  the  interval  (-T,  T) .  It  can  easily  he  seen  that  for  the  system  in 
' 4 . 110)  the  conditions  of  (4.b5)  arc  met  when  the  limits  of  integration  are 
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which  are  be  1  ng  transmitted  simultaneously.  I'he  average  power  of  signals 

and  :  f  1 1  )  i  s  I’  .  It  is  evident  rliat  ball'  of  the  information  trails- 
t  i  s 

nutted  is  carried  l\v  the  former  signals  and  half  by  the  latter. 

In  a  channel  with  known  and  invariable  initial  phase  there  two  signal  . 
svstems  are  easily  separated  by  phase  selection.  In  a  channel  ol  indeter¬ 
minate  phase  this  selection  is,  generally  speaking,  impossible. 

In  fact,  if,  for  example,  A.  ( t  )  -  B  1 1  '  ,  t.nen  signals  c..^*(tl  and  ;• !  *  <  t  J 

will  be  indistinguishable  in  incoherent  reception.  11,  however,  t ransmi s  -  i on 
i<  restricted  only  to  ei’her  one  of  these  signal  sets  they  may  be  d  i  s  t  i  r.  gu  i  she  ' 
I rom  each  other  eien  in  incoherent  reception. 

!  b  '  -  a -sort  at  i  on  may  be  supported  as  fellows,  Ue  .%  i  I  1  regard  sjgt.il-. 
a  t’  as  points  in  a  B- d  i  mens  i  ona  1  space  where  B  dll  is  the  signal  '•  i  .. 

I  Men  signals  ;  (ll(tl  and  r.  j  '“'it)  will  be  the  projections  of  z ;  It!  "ii  tw< 

mutually  orthogonal  B  J-dimensoiii.il  spaces  and  ;v  shifting  all  tin. 

phases  of  the  cmipnients  of  ?  _  *  '  t  -  bv  J  we  ma\  match  tliese  signals  with 

subs  p.'  ce  s  ,.  If  the  phases  of  all  the  component  s  ot'  either  signal  is  s1  1  ft  ed 

b%  ingle  .  ,  wb.icli  changes  iron  '  in  .  ,  the  ci  r  respoinl  i  ng  uunt  will  describe 
a  circle  Ivun;  m  a  plane  perpend,  ifiil.tr  to  sub-.paci  S  I  he  points  lying 

on  this  circle  are  indistinguishable  in  incohevnt  reception. 

: ut  different  non i nt ersect i ng  ircles  correspond  to  the  various  signals 
'  1  > 

;  ‘  t  heretuv  all  s'.gnils  ;  t  '  ,  it  the-,  ire  1  i  s  t  i  ngu  1  shah  1  e  in  co- 

’n  ret;  t  r>  <■;>;  1  a; ,  retain  d  i  t  1  ngu  1  sha1, 1 «.  even  1  a  incoherent  reception.  !  he 

s  t  rue  t  the  s ys*"i".  of  ignais  .•  -  '1. 

Ilius,  an  ideal  channe  1  with  exactly  known  parameters  of  signals  of  power 
1'  na\  be  represented  as  the  superposition  of  two  channels  of  indeterminate 

phase,  each  ol  which,  has  signals  ol  power  I  and  transmits  half  ut'  all  the  in¬ 
formation.  lie  r a  e ,  carrying  cap.icitv  (  _  I  a  channel  of  indeterminate  phase 

1 ! 

must  Pe  half'the  carrying  capacity  if  an  deal  cl.aliiie  I  which  has  a  signal  of 
Uia1  the  power,  or  b;>  expression  id.s-l 

;  1  | 

•stricth  speaking,  the  circles  ce rn-sponu  1  i.g  to  the  two  s;g,.ils  it'  and 
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c,  (ti  mav  coincide  in  ’he  case  where  :  ’  -  ( t  I  or  A  .  ( 1 1  =  -  \,  j  t  )  . 

'  I  k  1  k 

these  oppos  1 1 1  signals  an  1  ml  1  s  t  i  ngu  i  sha  1  e  in  incoheiant  reception  ml  one 

1  gnal  ot  each  pair  ot  opposed  signals  rimt  f,-  excluded  from  sestet;. 

;  'fit  !,  whii.li  is  sin  t  able  for  a  lianne  1  w  1  t  h  indeterminate  phase.  The  number 
1  1 

u!  li  t  inguish.il  i  *-  signals  may,  morei'ver,  l>e  reduced  b;.  not  more  than  halt, 

II11  .  1  n  rt  a  1  I  merit  .  however,  introduces  only  a  slight  correction  to  the  rate  at 

which  1  til  orr  at  1  on  is  transmitted,  and  when  pa  s  nig  to  .1  limit  II  •  "  1  ,  this 

1  r  n  c  t  1  on  t  ends  t  -  >u  .1  rd  .-<■  ro . 
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is  the  carrying  capacity  of  the  j  dea  1 
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therefore,  when  the*  signals  arc  weak  the  carrying  capacity  of  a  channel 
cl'  i  inlet  >'  nn  i  nat  e  phase  hardly  differs  from  that  of  an  ideal  channel.  As  signal 
power  increases,  however,  the  difference  between  these  carrying  capacities 
widens  and,  at  the  extreme,  phase  indeterminacy  reduces  carrying  capacity  by 
half.  l'h is  is  not  an  unexpected  result.  Kith  weak  signals  the  small  di  f 
ferenecs  in  initial  phase  of  the  two  signals  are  masked  by  noise,  and.  therefore 
the  ideal  channel  with  completely  known  incoming  signal  phase  has  no  essential 
advantage  ( i  "  the  sense  of  signal  i  r.di  st  i  ngu  i  sliabi  1  i  t  y ")  over  a  channel  of  in¬ 
determinate  ]■;.  m''.  Increased  signal  power  uncovers  the  possibility  of  better 
distinguishing  i gna 1  phases  in  tin  idea!  channel,  thus  resulting  in  signifi¬ 
cant  difference  in  carrying  capacity. 


1  ■'  ■••ii.nal  power  1’  and  spectral  noise  density  “  are  prescribed  and  fro- 

1  ui.  .  i>  nat  rest  ri  ct  c-i .  the  maximum  carrying  capacity  when.  1  •  •  may 

he  determined  fror  expression  i-l.lldi,  taking  into  account  that  !'  1  : 
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i.irl’.ei  den.cd  expression  lo.Sb  i  oi  an  idea!  channel. 


Ih  juest.  to  whether  it  'n  possible  to  show  a  regular  method  for 

the  -eh  '  n  if  ir.n.ils  wh. ,  cii  ;  nn  i  tie  for  the  attainment  of  the  carrying 
.apacit;.  1 .  i  1 .'  ha  not  been  resolved  for  the  general  case.  However,  for 

..  channel  w.tu  m  ited  pas-d  am.  such  a  method  does  exist.  Wo  will  shew 

that  wit!,  i  g;  ::  .!  power  .uni  i  ntert'er. cnee  spectral  density  i  system  of 

sigiuils  rti.  -gun  i ;  ■  an  i  ntetis  :  i  ied  s.  use  provides  for  the  carrving  capacity 
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n  (•t.ll.'l.  H, ;  ;  •  an-  to  n  for  a  svst'--  consisting  of  m  -  e  signals  are 

orth.ogona  1  in  an  :  •  nsificd  s.iisc,  tlie  probability  o!  correct  r-cepti  on  with 

i  sufficiently  Ian,  e'.-eeds  1  ,  where  is  a  positive  number  as  small  as 

:cs i red  i  f 
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He  will  proceed  fror  ■•xpre-.si  n  '  !.-lui  fa-  the  probability  o'  correct 
:  -cepti  n  u  in  the  case  e  m  optimal  incoherent  decision  principle: 


\v  '  /.a 


who  r< 


Using  the  integral  representat  ion  of  a  modified  Hessel  funct 
write  it  in  the  following  form 
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I  ,  we  have 

(  1 .  1  1  ~  i 

Ui  1 1'u  1  Oiled 

dees  not 


oi  ,  in  1  lght  of  (4.110), 
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MM  - 


2 '.h  n): 


(4.118) 


[  I  i  mi  |  ’  -  it  a): 


If  condition  (4.114)  is  mot,  it  is  possible  to  find  0  such  thut 


or 
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(4.119) 


Having  boon  given  a  sufficiently  small  1  satisfying  condition  (4.1191,  it  is 
possible  to  find  o  •  0  such  that 
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Then,  considering  that  >2  h  >  i, 


I  -  -  «xp  | - ^  t|  J/|  of  1  f\|.  -  \  ( I  [II  ’  {  '-*  /  r(  ill’ 


Wien  1  Tj  =  <•  /2ry 


r  i 


1  ■  exit 

I 

from  (4.118)  and  (4 . 121) 


■Mi  hi 


$sl  exp  |  ■/'(//'  i  ;-i 


(4.121) 


(/  {I  -  <  \[<  [  /(//''  <. i] J ’*  ' 

I  -  -  (III  ■  I  )•  xp(  /  |  // '  !  o  j| 

'.>  1  iih  x;>  [  /  i  //  ;  o i] 


Considering  that  m  =  c  ,  wc  obtain 


Setting  T,  =  (l/‘)ln2/c,  wc  finally  obtain  the  result  that  with 
T  '  max  (T0,T,,T2) 

Q  >  I  f. 
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which  is  what  we  wanted  to  prove. 


We  will  remind  the  reader  that  the  initial  formula  (1.16)  was  obtained 
under  the  assumption  that  during  time  I  the  initial,  phase  of  the  signal  remains 
practical  ly  unchanged.  Inasmuch  as  in  the  proof  presented  it  was  assumed  that 
T  could  be  as  large  as  desired,  it  lolds  only  for  a  channel  in  which  the  phase 
of  the  signal  does  not  fluctuate  huf  remains  unknown  when  the  decision  system 
is  designed,  so  that  only  incoherent  reception  is  possibh  , 

for  the  case  when  the  initial  phase  of  the  signal  fluctuates  rather 
rapidly,  computation  of  the  carrying  capacity  ot  the  channel  ••ntails  great 
difficulty,  for  the  purpose  of  obtaining  an  evaluation  of  this  earning 
capacity  from  below  it  is  possible  to  resort  to  t ho  following  reasoning.  We 
will  select  a  suff  i  ci  cnt'ly  small  interval  of  time  T  during  which  the  phase 

practically  does  not  fluctuate  and  we  will  transmit  a  message  with  the  help  of 
a  sequence  of  binary  signals  of  duration  1  1  .  We  will  perform  coding  in  a 

discrete  channel  by  joining  rather  long  sequences  of  information  symbols  and 
by  guaranteeing  a  given  (as  small  as  desircl)  probability  of  error  of  decoding 
with  a  transmission  rate  which  is  as  close  as  desired  to  the  carrying  capacity 
of  a  discrete  channel  ( J . 28 ) .  In  natural  units  this  carrying  capacity  can  be 
written  in  the  following  form 

C  'r  (In  •  /'In/'  :  (I  /»>  ]  •  (I  />i]  natural  units  sec.  (4.1  2  2 1 

where  p  is  the  probability  of  error  in  a  discrete  channel  depending  on 
h  =■  IM  /  .'  . 

The  maximal  carrying  capacity  of  a  discrete  symmetrical  biiury  channel 
will  occur  when  the  probability  of  error  is  minimal.  The  latter  is  provided 
for  in  incoherent  reception  bv  the  selection  of  an  RPT  svstem  for  which 
-  h  •’  2 

[i  -  C 1  / 2 d e  .  fixpressing  T  by  b  and  subststuting  in  (4.122)  the  value  ol 
the  probability  of  error  we  find1 


■f  ( I  !  '•  v  i  !n  I 

V  •  >  \ 


'Strictly  speaking,  formula  (4.122)  for  RPT  is  not  correct.  It  holds  for  a 
channel  without  memory  while  with  RPT  there  is  a  tendency  toward  paired 
grouping  of  errors.  However,  this  formula  can  be  used  as  an  evaluation  from 
below  inasmuch  as  a  channel  with  RPT  can  be  converted  into  a  channel  with  in¬ 
dependent  errors  by  considering  separately  symbols  with  odd  and  even  numbers 
and  joining  them  separately  into  combinations  of  a  correcting  code.  If  the 
dependence  of  errors  is  considered,  the  carrying  capacity  proves  to  be  some¬ 
what  greater  than  (4.122). 
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and,  consequently,  the  probability  of  error  in  transmitting  signal  2j(t)  in 
an  actual  circuit  with  filters  g ^  ami  g  ,  is  equal  to 
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where  .  is  determined  for  signals  -  ^  )  and  cjtl  and  m  is  the  ratio  between 

the  values  of  the  envelope  at  instant  of  reading  in  filters  g  and  g,  when 

signal  r  it)  is  delivered  to  them:  ’ 

1  \  // 


/[f |\ ..f  ■ 


:  j  It  i  is  a  signal  matched  with  filter  g  and  having,  the  same  power  as  signal 
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Similarly,  we  may  determine  the  probability  of  error  when  transmit*  ,ng 

s  i  gna  1 


i  see  section  » . '  i  !he  results  obtained  t'or  reception  with  post  •  detev  t  ion 
integr.it  ion,  particularly  formulas  •  1.93'  and  (4.931,  are  tru  only  to  tin  de¬ 
gree  of  accuracy  to  which,  the  probability  distribution  of  tlie  f  luctuat  i  ons  at 
the  output  of  the  integrator  r.av  be  considered  normal.  In  t  :t  ,  with  a  finite 
value  of  fl  this  probability  distribution  differs  from  norm..!.  \  syr.ro  try  :n 
fluctuation  probability  dj  s  t  ri  but  :  oj.  especially  noticeablei  at  the  output  of 
an  integrator  which  contains  .nl\  noon  increases  the  probability  of  error, 
frith  largt  values  if  'f(  the  absolute  value  of  this  correction  is  very  slight, 
but  if  error  probability  is  low,  as  occurs  when  h  1,  the  relative  error  of 
tbe'se  torrulus  nav  become  verv  substantial.  Iherefore,  the  larger  It  is,  the 
larger  must  also  be  the  value  of  H  at  which  these  expressions  g.ve  a  good 
app  rec  i  at  i  on  . 


If  we  io  not  take  this  c  l  r  curs ;  ance  into  tccoiu.t  we  r.a\ 
p.*  radox  j  ca  1  conclusion  that  it  is  impossible  for  a  nrnoptrm.ur 
an  error  probability  which  is  beneath,  the  lim.it  determined  bv 
potential  resistance  to  interference.  bn  fact,  assuming,  for 
the  value  of  '  f  1  in  expression  (4.93a  i  is  fixed  and  selecting 
which  satisfies  the  condition 
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CHANNEL  WITH  SLOW  GENERAL  FADING 
(SINGLE-TRANSMISSION  RECEPTION) 
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Figure  5.1.  Multiple  Boon  Propaga- 
t ! on  of  Si qna ! . 

At  the  input  of  t  lie  receiver  arrive  n  beams,  each  with  its  own  preparation 

perioil  t  .  aiul  its  oun  transmission  euelfieimt  ..  I’el.ativeiv  narrow-band 
I1'  ■ 

si  vna  Is  mav  he  thought  of  as  haiitu’  identical  t  and  .  for  all  their  coinpo- 

pi  1 

nents,  i  .  e .  ,  i  lulependent  of  subscript  k.  Ihen  t!te  signal  beinp  received  may 
in  represented  as 

.-i/i  V  it,  V  , , .  ■  ['••••  1 
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\’  ;■ ,  V  c  ,  i  ■  [  •  V  /,  ’  •  •<  •'.»!  ' 


ii'.eie  t  11  tin-  n’.eraip  rropavati  >n  tiau  f  -r  ill  i>e:i::s  ,  ,  -  k  . ,  J  t 

p  '  il  0  | 

I  t  I  ;  and  it  it:  t  s  add  it  i  \  e  tie  l  se  . 

In  tie'  vase  in  quest  i  n  tin  tullowmc  liieiualit  h.  KN  true: 


i-iv-.  ; 


leiiii  the  '.ali.es  it  ,  f  >r  i  e'-rt  i:n  subset  :  pt  ;  which  lie  in  the  region  *’  f 

i  k 

’■k  t  *o  J-k  '.t.  differ  from  each  other  hv  ne  more  than  2 -\  t  •  "•  f".  It 
1  i  J  l  1 

•  e.  therefore  I  e  supposed  that  it:  first  apt'  re  v  i  r  at  :  •  a.  file  '.allies  a  ,  ie 

K”  end  n  tin  number  .  f  a  component  1  ,  » 1 1 ):  o i ,;! .  'or  ! i  t  1 1- n t  '.allies  o{  ••id 

•  cr.pt  l,  i.e.,  f  ’  r  di  ffef-nt  bears,  'lev  na>  (,e  sufst  m? tally  d.  i  fferent  . 
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|i  |  ;••  ;i  ;  0  jreijn  .,  y  ;  l'  i  . 


(in  the  following  we  will  drop  t lie  prime  from  t  and  assume  t  to  be  the  moment 

of  starting  to  read  the  time).  The  magnitude  ..  may  be  formally  regarded  as  the 
length  of  a  vectoi  with  components  ..  and  ..  . 

C  ii 

I  he  incoiMii,  giul  thus  differs  from  the  transmitted  by  random  trans¬ 
mission  coefficient  ..  and  a  phase  shift  which  is  random,  but  approximately 
the  same  for  all  tin-  frequency  components.  This  fading  is  called  general  (or 
smooth)  since  the  relations  between  the  amplitudes  and  phase's  of  the  signal 
components  do  not  change. 

To  analyte  the  conditions  lor  transmitting  information  in  a  fading  channel 
we  must  Know  the  probability  distribution  of  the  random  variables  .  and  ■  . 

This  may  be  found  by  assuming  that  the  number  n  of  incoming  beams  is  so  great 
as  to  permit  the  central  limit  theorem  to  >*e  applied.- 

bet  us  study  two  extreme  «.u:.es  where  the  differences  >n  piopagati  >n  time 
t.  attain  values  which  substantially  exceed  the  period  o'  the  avrar-’  signal 


requeues- 


wlie  re  t. 
at  i 


n  the  tirst  case  may  be  much  taigcr  than  2  (1  'gure  5.2'.  In  this 

case  *'10  random  variables  cos.,  and  siiu^.  have  a  mat  lien, at  i  ca  1  expectat  ion  ol 
practicallv  zero  and  identical  dispersions  of  0 .  a ,  while  cos.,  and  ...sin.. 

iiii 

are  values  rtf  limited  dispersion  witli  mathematical  expectations  of  :ero.  When 

n  is  large  the  sums  of  ..  mav  be  considered  normal  iv  distributed  random  varia- 

L*  S 

bles  with  average  values  of  tero  and  identical  dispersion.  Under  these  condi¬ 
tions  has  a  Rayleigh  distrihuti  >n  and  its  uni  dimensional  probability  density  is 

•live  a  good  enough  approximation  is  here  obtained  when  n  is  no  more  tnan  five, 
which  is  almost  1 ’.  s  tiie  case  in  niactice. 

•  The  inequal i tv  .  >■  2  .  does  not  at  all  contradict  condition  (a. la)  since 

’  ti  av 

signal  frequency  band  I-  is  practically  always  at  least  hundreds  or  thousands  of 
times  less  than  u.,,,,/2  . 

dV 

"1  no  following  is  the  more  customary  notation  for  a  Rayleigh  probability  distr. - 
bu  ion  densitv: 


It  does  not  differ  from  that  used  in  the  text  if  I--.  The  advantage  of  the 
notation  in  (5.3)  is  that  the  mean-square  value  of  transfer  coefficient  u- 
figures  in  clearly  as  a  parameter. 


P 


(5.3) 


-'(n)  -•‘|1  ‘xp.^-  .  'il, "’"l. 
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where  . 


is  the  mean-square  value  of  transmission  factor  p. 


Phase  shift  ",  as  the  arctangent  of  the  ratio  of  two  independent  normal 
identically  distributed  random  variables,  has  uniform  probability  density  in  the 
range  from  0  to  dir.  Rayleigh  fading  is  the  name  we  will  give  to  this  type  of 


fading . 


Figure  5-2.  Vectorial  Repre¬ 
sentation  of  Beams  at  Receiver 

Output  When  At.  >  2n/z) 

xmax  av ' 


Figure  5-3-  Vectorial  Repre¬ 
sentation  of  Incoming  Beams  When 

it.  >  2n/w 
'max  av 


In  the  second  case  the  probability  tl  at  ..  will  reach  2“  is  very  slight,  i.e., 

the  phases  of  the  incoming  beams  (Figure  5.3)  group  themselves  around  an  average 
value  of  zero.  Assuming  a  symmetrical  probability  density  for  ;  we  easily 

satisfy  ourselves  that  the  mathematical  expectation  of  sini)u,  as  an  odd  function 
of  ^  is  also  zero,  while  the  mathematical  expectation  of  cos,,  (an  even  func¬ 
tion)  differs  from  :ero  and  is  positive.  Therefore  the  mathematical  expecta¬ 
tion  of  variable  u  is  zero  and  that  of  ..  ,  which  we  will  denote  bv  a  ,  is  more 
s  c  p 

than  zero  (since  variable  „ .  Uy.  Propagation  factor  ;. ,  as  the  length  of  a 

vector  with  normal  components,  one  of  which  has  an  average  value  other  than  zero, 
obeys  the  generalized  Rayleigh  distribution.  Its  probability  density  is 


C'(ji) 


(5.4) 


Here  z£  =  z-  -  z^  is  the  average  value  of  the  square  of  the  fluctuating  portion 
of  the  propagation  factor. 

If  we  imagine  as  the  sum  of  z  +  i.^  the  mathematical  expectation  of  z^ 

is  zero.  Therefore  ..  may  be  considered  the  geometrical  sum  of  the  constant 
vector  of  ..  ,  which  is  called  the  regular  component  of  the  transmission  factor, 

of  the  two  normally  distributed  fluctuating  vectors  of  average  value  zero, 
and  „  (Figure  5.4).  The  variable  i,  .  is  the  average  square  of  the  geometrical 

of  u  r  and  z  . 
cl  s 
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the  receive!  is  picking  up  beams  which  have  been  reflected  lion,  widely  separated 
ionospheric  (or  tropospheric)  regions.  Thus,  for  example,  in  shortwave  communi¬ 
cations  beams  may  come  to  the  receiving  antenna  which  were  reflected  from  layers 
1.  and  T,  of  the  ionosphere  (figure  a .  5 )  ,  or  which  have  undergone  a  number  of 

different  reflections  (figure  h.b),  etc.  for  the  most  part,  moreover,  it  is  not 
the  simple  beam  which  traverses  each  of  these  pathways,  but  a  beam  consisting 
of  a  large  number  of  individual  components  such  as  are  shown  in  figure  a .  1  . 
therefore,  each  of  the  arriving  beams  which  have  undergone  various  reflections 
is  also  subject  to  fading. 


I  he  re  f  o  re  , 


in  selective  fading  the  phase  shifts  ...  differ  as  the  subscripts  k  differ. 

j-  1  k 


V  ,  *  V  1*  r  |/i,  '  '  -,t  ■  ,.k)  '  /:  l.’l 


\  <  h  \  ,  r  r*  y  /  -i, )  j i ,  ■  i j  ✓  i »,  ' 1  ( .  I 


>  i 


r,  V  ...  ,  i ; 


.  ,  i.  ■  »■  i  *  i 


(a.r») 


whe  re 


l  (y-  -0  1  ii*- 


'  I  V  .  V  . 


li  ft  c 


Ihus,  in  selective  failing  each  of  the  frequency  components  ot'  the  signtil  ha 

•wn  f ransr  i ss i on  coefficient  .  ,  and  its  own  phase  shift  •  .  The  variables 

K  •  c 

itli  different  subscripts  k  arc,  >f  course  ,  i  ntercorre  lati  d  .  I'll  i  s  follows 

the  fact  that  identical  coefficients  .  enter  into  the  e.xpro  v  i  on  for  . 

I  ’  k 

correlation  is  t  lie  greatir,  the  smaller  the  di  ffe  fence  between  the  fre- 
ies  of  the  components  for  between  the  f  subscripts)  and  the  smaller  the 
•rence  '!.  in  the  paths  >>:  tb.e  beams.  \s  tor  the  uni  d  i  mens :  cna  1  probability 


'  i  '"it  I  Oils  ol 


,  m.i  ,  ,  th'-v  arc  obvi<cis|\  the  s,an<  as  in  general  f'avleigh 

t  1.  ■  ' 


.  let  us  r..te  that  under  i  dent  i  c.i  l  propagation  londitions  lading  may  mani  ■ 
itself  a;  gi'neri!  if  the  signal  i'reqiK'ncy  hand  is  narrow  or  as  selective 
•e  signal  is  wi  (!••-*-. md.  With  iiam  w -band  signals  when  k  ,  k  j  is  small 

•  ;  i.n  if.,  la  :  .  inlated  if  !  he  values  ui  t.  are  commensurate  with,  f .  In 

i 

■  ca.es  the  rieilivc  fading  i  accomp..nud  bi  a  i  elated  phenomenon  in  that 
.id  i  v  i  du  1 1  signal  I'lcs-rts  ip  the  beams  which  h,a\ e  l  ravcmeil  different  paths 
ip  .the  phene;;. mi  >;  i  ■  .ho  -  s  i  gna  1  s  I  .  Selective  fading  and  echo  -  s  i  gra  1  - 
1  ■  ■  1 1  sgussc!  i  n  t  ! i . i [ ■  t  r  '.  !  I  . 


1 1  t  hi  v  a  1  ii>-s  i .  f 


lined  Ciir-i.int,  tr;m  me-a.n  factor  .  and  phase 


weiild  be  random,  but  constant  for  a  riven  , T,  mne  1  .  •Vtuallv,  wav 


reflection  and  dispersion  conditions  in  the  ionosphere  or  troposphere  continual  1 
change.  Therefore  ;.  and  are  random  processes.  The  changes  of  .  and  ■  in 
time  may  be  characterized  by  a  correlation  factor  [1]  which  depends  on  the 
physical  processes  in  the  ionosphere  (troposphere)  and  may  be  determined  only 
experimentally. 


We  will  consider  separately  the  cophasal  ..  .  and  quadrature  components 


of  the  fluctuating  part  of  the  transmission  factor  which  were  determined  abo\e 

(Figure  5.4).  Ubviouslv  ..  .(t)  and  ..  ( t )  are  normal  random  processes  with  the 

c  t  s 

same  correlation  coefficients: 

...  (')  ■  C  •  ■)  I*.  I.’):*.  ('  ■'  ■) 

(5.5) 


A’  i  - 1 


14, ‘  C  •  4  1*.  (!);*.  ('  4 

P.f 


where  the  line  indicates  statistical  averaging. 

We  will  designate  the  coefficient  of  mutual  correlation  between  ..  .  and 

-  .  c : 

R  :  r. .  .  )*.,  (»»/.  (<  ■  ■)  c  •' 


A’  (•) 


(5.6a) 


Here  it  is  considered  that  .  =  w  . 

cl  s 


As  is  known,  R  (  ■ )  is  an  even  and  R(t)  an  odd  function  of  :.  F  pec  i  I'ica  1 1  v  . 
R  (0)  =  0. 


We  will  set  R-  (t)  =  IT  ( : )  +  IT  (•).  Then  the  correlation  coefficient  is 


related  to  ( r )  by  the  relationship  (see  [1J,  formula  8.31): 


1(1  r) 


A'  (-.1 


l!,‘"  “'T  A*  i •  i 

i  '  ”  1  Cl 


( 5 . 6b  i 


With  sufficient  inaccuracy  for  engineering  calculations,  when  R  "  1,  it  can  he 
assumed  that 


A-,  (-.)  A’.;  I,,  A'-'r-i  ;  A’-'I-.I 

and  with  a  large  (close  to  unity)  values  of  R 


0 


A’.  I  ,  .  1 1  A- 


Most  authors  suggest  the  following  approximate  formulas  for  correlation  co 
efficient  R(  )  with  interference  lading: 


A’ .  i  -  > 


\ 


(  5 .6c'1 


or 


RJ-.) 


(  5  .  t'd  1 
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I'lu'  variable  •  describes  the  rate  of  lading.  Specifically,  when  we 

1 

have  respect i ve  1\  ,  from  tormulas  (h.bc)  and  (T'.bd),  R(  ,  e  or  it,  ;  )  - 
j  ^  IK 

=  e  .  Therefore,  ;  is  often  called  correlation  time  or  the  average  fading 

period.  According  to  experimental  data  for  ionospheric  shortwave  radio  commu¬ 
nication  the  variable  ranges  from  0.1  sec  (over  very  long  distances)  to  0  sec 

(over  relatively  short  distances)  [J,  3,  4,  5).  for  other  channels  ^  may  differ 

greatly  from  the  values  indicated. 

For  investigating  conditions  of  signal  transmission  in  fading  channels  what 
is  important  is  not  the  absolute  value  of  the  fading  correlation  time  but  the 
relationship  between  the  rate  of  fading  and  the  rate  of  transmission.  We  will 
call  the  fading  slow  when  :  T,  where  T  is  the  duration  of  a  signal  element, 

K 

and  fast  if  ■  is  of  the  same  order  as  T  or  less  than  T.  In  the  limiting  case 

when  T/:,  •  0,  it  can  he  considered  that  the  variables  -  %  and  do  not  change 

K  C  S 

at  all  for  the  duration  of  one  of  even  several  signal  elements.  Under  these 
conditions  we  will  call  fluctuations  in  the  transmission  coefficient  fading  at 
a  zero  rate.1 

In  most  channels  which  are  used  at  the  present  time  for  the  transmission  of 
discrete  messages,  slow  fading  which  can  often  be  considered  with  good  approx i 
motion  as  fading  at  a  zero  rate  occurs.  Still,  in  many  cases,  specifically  in 
space  radio  communication  and  in  several  radio  communication  channels  with 
tropospheric  scattering  fast  fading  is  encountered.  It  should  be  remembered 
that  tiie  rate  of  fading  is  determined  by  the  relative  duration  of  signal  ele¬ 
ment  T  and  therefore  one  and  the  same  physical  communication  line  may  be 
character i zed  by  slow  fading  if  signals  with  a  small  T  are  transmitted  and 
fast  i f  T  i s  great . 

Hxporienee  shows  that  selective  fading  predominates  in  the  shortwave  range 
if  the  signal  frequency  band  is  broader  than  several  hundred  cps .  With 
narrower-hand  signals  the  selective  nature  of  the  fading  does  not  manifest  it¬ 
self  and  in  most  cases  fading  may  be  considered  general  under  these  conditions, 
(lencral  fading  is  also  often  encountered  in  tropospheric  scattering.  We  would 
remark  that  the  nature  of  signal  fading  at  receiver  input  depends  on  the  direc¬ 
tional  pattern  of  incoming  beams  decreases  and  beams  are  principally  received 
which  have  little  course  difference  At..  Therefore  under  identical  conditions 

i 

of  propagation  the  signal  received  on  a  non-d irect i ona 1  antenna  may,  for  example, 


The  classification  of  fading  according  to  rate  presented  here  is  generally  accep¬ 
ted.  Specifically,  it  differs  from  the  terminology  used  in  the  first  edition 
of  this  book  and  in  work  [7j  where  slow  fading  means  fading  which  we  now  call 
fading  at  a  zero  rate  and  fast  fading  Tin  the  sense  .  •  T)  is  not  considered  at 
all.  '  K 
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have  'L  it\  t  i  \  i  Kivicigh  !  biding.  ,vlu  1c  th.it  um-i  u\l 
mtiiir.,1  :..»>•  have  general  qua- i  Kicleigh  lading. 


:  \  a i :■  ■  i 


l  nt  er  l  v  relic*.  phenomena  arc  not  the  only  cau-e  ot  chai.e  ;n  in..:  in,  j :  t .» 
- 1  run,;  t  ii  .  Relatively  -lew  (heuily  and  daily  i  t  ransii,  i  -  s  i  oi.  .oi'll  n  nM  iluctua 
!  i,iii-  an1  c.ium'J  f\  number  ot  other  iva-on-,  tor  ex. imp 1  •- ,  • nangc-  ;  ;i  do,  if  , 

ab  >  o  rp  t  I  on  in  tlu  i  on  >sphere  ,  changes  in  troposphc:.  teipcrntui  o  g  i  u. ;  ,  ot 

these  fluctuation-  art  s, met , me-  cal  ltd  abs* ■  r;  t  i  on  lading,  Ilimr  i  t  t'e,  t 
i.  v  fiitiun  i  cat  i  ■  aj-  roducos  to  tho  reception  ot'  ■  on.o  ivsar.r,  unde  r  bottot  ,  ind  ,  ! 
other--  under  worse  conditions,  ordinarily  thee  change-  i  n  tr.ii.  ::  .  : 

el'  t'l  ci  out  i.which  is  averaged  over  a  period  ot'  about  .m  houri  are  c  h .  ■  rad  e  r :  ::ed 
by  nornillv  1  oga  r  i  tin;;  i  c  probability  distribution. 


li  wave 


\  Il-sc  r  i  p  t  i  on  ot  fading  in  radio  channels  would  be  incomplete  i!  we  did  in  t 
nett  t  ion  t  olari  tat  ion  ot'  i  ncor  i  ng  waves.  \s  .  rule  wit);  reflect  i  on  ot  radii  wave 
the  p  I  ai  e  ot'  po  t  an  .:at  i  on  changes.  If  a  transmitter  or  its  hates  with  ■  cel  t  a  i  :i 
pelarit\  linear  or  angular.!,  tlten  under  conditions  ot'  i  nten  eivuce  la. liny,  a 
wave  arriving  at  a  receiver  is  tinpu  1  a  r  i  zed  or  partially  polarised.  ivhen  this 
occurs  the  fading  of  t  lie  polarized  components  ot'  a  received  wave  are  weak  h 
rreluted  with  one  another  (a).  If  an  emitted  wave  is  unpo  I  a  ri  :;ed  the  re¬ 
ceived  wave  a  iso,  as  i  rule,  is  unpolnri zed.  Dividing  it  into  two  compuien  t  s 
whicn  arc  orthogonal  with  respect  to  po  I  ar  i  zat  ,  on  ,  we  are  able  to  see  that  tin. 
lading  in  them  is  very  weakly  correlated.  IT, is  phenomenon  is  usually  called 
po  1  a  r  l  zat  ; ,  >n  lading.  However,  in  our  op, inion,  pot. in  zat  ion  fading  should  not 
'•e  con.pare,:  with  interference  fading  inasmuch  as  h.iw,,  ;on,"pts  describe,  i:. 
es-ence,  trto  sides  of  one  and  tho  same  phenomena.  ’  >w  general  1  ad i nr  will  be 
oi.s.dereu  in  this  chapter  and  the  one  tollowing.. 

f  .  2  .  Coherent  and  Hmobereni  Re_*n!ion  Unde''  Conditions  i  i  General  fjdinn  at  a 
Zero  Rate. 

Reception  in  Channels  with  Rayleigh  a raj  Quas i -Ray  I e i uh  Fading 

It'  general  fading  occurs  so  siowlv  that  the  changes  in  .  uni  m  meaning 
signal  elements  in  clos"  prox  irni  tv  to  each  other  an  -trci.giv  i  nte  rcerre  1  ..led  , 
then  analysis  of  the  prev  iou-ly  received  signal  element.-  can  wit1,  a  g'e.,t  degree 
(if  reliabili’y  predict  the  expected  parameters  ,  f  t’u*  next  clement.  Under 
these  conditions  reception  is  effect  dated  just  a-  it  tin:  were  r.o  tad,  .ng  and  t  lie 
s  ime  signal  systems  ar.d  the  same  b-cisior.  ,-yst  c: ,..  th  it  were  - 1  tidied  I'i.ant  c  r  !1 

are  optimum,  but  with  the  difference  that  the  sv-tem  mu.-*  m  rut  i  mu  us  ly  r  : 

lit'.-!  to  confonn  with  the  expected  values,  of  .  os!  ii.is  :  .usual  iv  acc-. 

p  1  i  shed  by  means  of  an  ait  uniat 1  c  amp  1  i  t‘  n  a  t  i  on  os.t  mi  -  and  ai.  aut  or.  at  i  c  ph.ro 

and  frequency  control. 


'In  act  i  vo- 1  nterval  s>  stems  the  optimum  decision  principle  does  m  t  vf.-iu  nu  n 
fs.eo  Jaapters  III  and  I'J.  I  he  re  fore  such  system-  do  not  requir--  aut.omat  i , 
volume  control  in  the  receiver  even  during  fading  and  a’  :  .  mes  u-e  it  on.  I  \  n 
maintain  the  linear, tv  of  the  amplitude  Hume!  .  ircuit. 


w  .  M.  r  hr  v  v  t.’i.it  i  ik  ulu- :  -i  th.  of  !'» •  *  t  t  :  .  n  :  ■  *i  p  1 1.  \  !  14:  into! 

it  ■  about  t  he  :  r !  t  i  1 1  ,;u.-o  ..  *  ,r.  in.  :  :  1  1..1 !  iu!r!.'  hr.,.  1 

'  a  is  1  sit-  .1  si- 


1 in1  s  s«:k!  1  t  i  s  !,.i  1  r  r.>l  a!  1  !  1  t  .  of  o  nvia  .no  hmt’  i.  ■:  .. !  ..  ft  nr.  ••  i  itui  ’  <  !  e 

".ont  1:1  iKMiural  al  u  t  adi  np  imuli'i  Ma  ■-  u|  i 1  >•  1  *.  :  n  !  a  .t  ' :  ,  1 I 

;  .. :  .if  e !  e  f  -s  to  be  .usi  uittv.l  !  jt  l".  the  .  i  - 1  on  ■  ■  1  1 1  !  t  ti*  o.  .  . : .  •  t  •  •  i  \  nieitiet 

.loos  list  aitier  t  cfi  r  I'fuiuib  :  I .  :  .  ;  11  a  -.  t, !  u  ,  t;  at  t,.ii  •  ,  a-  .  rcpi.t  ed 

:  1  •  1  pi  von  i  UN  t  sin  t  siiu-i  tK  i.ilia-  i.t  th-.'  i.it:  01  t  ‘a-  ••  i  ,;n  1  1  ole-  <  nt  I'utuT  to 
M'lstrai  lu  iso  sb.'iisjty  h  .  but  durmy,  fidir.g  the  valiu  u  ;  •  ^fi  ciyc  in  nro- 
.  •  r  t  1  a*  t  s'  .  !  ho  tv  t  s.>  no  :  n  ivu  i  r,<  .!  !  it.  i  iu  •  :.t  ’  •  1  •  :  foba'- :  t  \  ■  •  t'  •  •  :  >  • 

.1  on  :  e.  op  t  .  of.  o  f  >  .  pna  I  v  . o:  .  11*.  w<  ;  a-- 1  .r.  c:  1 1  '  .  ;  . :  t  :  >  l  1'  1  1  j  t 
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In  thf  part  xiiil.tr  c  a  s  <•  of  .1  hinur\  s  v- 1  cr  with  opposed  signals  ( e  .  g  .  ,  I’M) 
J  and 
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while  with  orthogonal  signals  when  ,  =  1, 
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(5.11) 
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Similarly,  for  a  system  of  relative  phase  modulation  (RPM)  using  coherent 
reception  (polarity-comparison  method)  during  Rayleigh  fading  we  find,  by  sub¬ 
stituting  the  value  of  f(h)  from  expression  (4.99)  into  expression  (5.8)  and  in¬ 
tegrating  by  parts,  that 
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(5.12) 
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In  the  case  of  RPM  signal  reception  using  the  method  of  phase  comparison  we 
may,  by  assuming  that  fading  is  so  slow  that  the  amplitudes  and  phases  of  two 
adjacent  incoming  signal  elements  are  practically  the  same,  compute  the  total 
probability  of  error  by  averaging  expression  (4.102).  Let  us  solve  this  problem 
for  quasi -Ray leigh  fading.  Substituting  expressions  (4.102)  and  (5.4)  into 
expression  (5.S),  we  find 
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This  integral  1 s  tabular.  Taking  its  value  into  account,  we  find 
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In  the  case  of  Rayleigh  fading  k  =  0  and 


2  •  'A, 


(5.14) 


When  k  tends  toward  infinity,  as  was  to  be  expected,  formula  (5.15)  converts 
into  formula  (4.102): 


(5.15) 


which  expresses  the  probability  of  error  when  there  i no  fading,  figure  5.7  de¬ 
picts  this  relationship  for  various  values  of  k. 


Figure  5.6.  Selective  Fading  in 
Multiple  Ref  1 ect i on . 


Figure  5. 7-  Error  Probability  in 
RPM  In  Channel  with  Fading. 

-  —  incoherent  reception; 

- ,  coherent  reception. 


In  incoherent  reception  the  most  interesting  systems  are  those  which  are 
orthogonal  in  the  intensified  sense,  for  them  may  be  found  a  complete  error 
probability  expression  with  any  code  base  m  in  the  general  case  of  quasi  - 
Rayleigh  fading  by  starting  with  expression  (4.4S): 


! 
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This  integral  is  reduced  by  simple  transformation*  to  a  sun  of  tabular 
integral,*  and  finally 
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When  k  =  L'  wo  obtain,  in  the  case  of  Rayleigh  lading, 
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This  result  may  also  be  expressed  by  means  of  gamma  -  fund  i  oils 
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If  the  fluctuating  component  is  1  ack  i  rt>  ik  *  ■*-)  expression  i.s.li  i  turn-, 
into  expression  (-I.-ISJ. 


U\  substituting,  m  =  J  into  expression  .In  we  will  den  e 

r  •  :  i  * 


i  ■ .  l  i 


for  binary  systems  orthogonal  in  the  intensified  sense  during  mias  i  -  Ray  I  e  i  gh 
fading  and  incoherent  reception,  while  with  Rayleigh  fading  (k  0 


i\  h  e  n  k  •  •  expression  (a.l"i  turns  inn  -••pression  (J..19).  1  inure  .  h  dine, 

tb.e  rei  itionship  of  error  probability  in  incoherent  reception  ti  h^ . 


tioofc  5.8.  [rr<jr  r  »  obab  •  I  i  t  v  lof  <’»c  i  vo  *  I  n  t  c  r  v.»  I 
Binary  System's  in  r  *  Case  of  Incoherent  Perception, 


In  this  way  it  n  possible  to  detemine  the  prof  ability  o!  error  in  the  owe 
of  ituoherent  reception  d  binary  signals  with  the  same  level  el  power  i!  the 
condition  of  orthogonality  in  the  intensified  sense  is  not  met.  foe  will  base 
ourselves  on  formula  (I. 01'  whnh  ,’xpresses  the  probability  of  error  with  i  giver 
value  el  h  in  the  form  of  a  series.  Substituting  in  it  (*•.“)  and  assuming  the 
distribution  I  to  be  a  Ravleigh  distribution,  we  I i nd 
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where  i1-  det erni ih'i!  iron  term  la*  i-l.5~i. 


Ihatil.s  ’u  mil!'  it,  .oiiuT^'ikf  i !  tin-  series  tol  lowing  the  integral  sign, 
!  M-ru-s  «..ni  he  i :,t  egr.itcd  ten:  b\  t  <  it*. .  Indicating  foi  brevity 
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w i  1  !  ex;  fens  the  p rob.it> i  1 1 1 y  of  error  b>  tabular  integrals: 
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Viter  sul  ■<  1 1  tut  l  ng  here  the  values  ot  a,  b,  aiul  c  and  after  simple  trans- 
orr.it  i  ons  we  ubt  a'  n 
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(5.191 


In  the  particular  case  when  .  =  0  (signals  are  orthogonal  in  the  intensified 
<eiiM  forr.ula  .'.19  becomes  (5.1“a).  In  the  other  extreme  case  when  .  -  1 

ign.ils  i!  i  tier  only  in  tlie  initial  phase  l,  p  -  1/J  as  should  be  expected  in  in- 


i  oherent  reception.  If  h^(l  -  .  ■  )  *•  1  ,  tlien  from  (5.19J  ve  obtain  a  convenient 


ipprox mate  expression  for  the  probab i 1 i tv  of  error: 
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P  ■ 


(5.19a j 


comparing  this  result  with  (5.17aJ,  we  can  assert  that  small  deviations  from 
orthogonality  are  equivalent  to  a  decrease  in  signal  power  of  (1  -  ml*1  times. 


:s  i  - 


">  1 
The  dependence  of  the  probability  of  error  on  h“  with  various  values  of  p“ 

for  Rayleigh  fading  (k“  =  0)  is  shown  in  figure  5.8. 

An  analysis  of  the  results  obtained  shows  teat  fading,  especially  Rayleigh 
fading,  increases  the  probability  of  error  g’ratly.  The  dependence  of  the  pro¬ 
bability  of  error  on  lr  in  the  case  of  Rayleigh  fading  is  in  all  cases  close  to 
inversely  proportional,  in  distinction  from  a  channel  in  which  there  is  no  fading. 
Therefore,  to  obtain  a  sufficiently  high  level  of  fidelity  in  reception  in  a 
channel  with  Rayleigh  fading  there  must  he  a  much  higher  ratio  between  average 
1 1  c tin- Vi t  power  in  an  insoniing  signal  anJ  the  spectral  density  ul  white  ncuS-  than 
in  the  absence  of  fading.  Quasi -Ray leigh  fading  is  an  intermediate  case  between 
the  absence  of  fading  and  Rayleigh  fading.  We  will  note  that  the  power  gain  does 
m.t  exceed  3  db  when  cGhercn.i  reception  i:  tired  in  the  pretence  ^1"  general 
fading . 

Reception  with  Unknown  Values  of  and  '• 


The  need  to  continuously  measure  the  values  of  the  channel  parameters  .. 
and  ■  greatli  complicates  a  receiving  device.  As  already  indicated,  for  active- 
interval  sy.  corns  the  optimal  decision  system  does  not  depend  on  values  of  a 
and  in  the  case  of  incoherent  reception  knowledge  of  ■■  is  not  needed  anil,  con¬ 
sequently,  ‘‘here  is  no  longer  any  need  to  measure  these  parameters..  However, 
it  is  poss.ble  to  deduce  the  decision  principle  in  the  general  case  when  the 
powers  of  the  received  signals  are  not  the  same,  assuming  that  the  values  of  .. 
and  arc  unknown  and  only  ’heir  probability  distributions  arc  known. 


Based  on  the  criterion  of  maximal  likelihood  we  should  adopt  the  hypo¬ 
thesis  that  signals  z,(t)  was  transmitted  if  the  conditional  probability  of 

arrival  of  signal  z' (t)w(z ' ' z,)  is  greater  than  the  conditional  probability  of 

^(z'lz  )  for  all  r  /  l .  Just  as  we  determined  the  optimum  incoherent  decision 

principle  in  Chapter  IV  by  using  ..  (z'':  ),  by  averaging  with  respect  to  n 

and  with  respect  to  ",  we  are  able  to  determine  the  conditional  density 
(z '  j  z^  ,a ,?)  .  If  ..  and  -  are  known,  then  according  to  (3.19)  and  (4.23) 


w(s'  |z(.(l.9)  - 


l 


- 1‘  (a,*  cos  0  i 


+  ft, »  sin  0 )} •  -f-  (ft?, 


— (ft,*  cos  0  —  a,,  sin 


(5.20) 


Averaging  (5.20)  with  respect  to  ;  and  with  respect  to  we  obtain 
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—  H  (/»/*  C'-s  0  -  sin  G)| '  \  u'  (b)  lu)  (/0  <f\x 


(5.21) 
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Substituting  in  (5.21)  the  values  of  the  probability  densities  of  oj ( t * )  and 
^(u),  we  can  find  w(:' |o  )■  for  a  given  specific  type  of  fading. 

In  the  case  of  Rayleigh  fading,  by  substituting  (5.3)  and  considering  that 
u)(e)  =  1/2",  after  simple  transformations  we  find  [7] 


'*  (i  ,  r 

where  similar  to  the  notation  introduced  earlier,  h  .  l.-  ill  is  the 

r?  v  J  ' 

u 

ratio  between  the  average  value  of  the  power  of  the  incoming  signal  .-^(t)  and 
the  interference  spectral  density;  and 
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It  follows  from  (5.22)  cl. at  the  decision  principle  is:  symbol  y  is  regis¬ 
tered  i  f  for  al 1  r  ^  l 


vvt-1  >•*. !  '•>  -> ;  •  ii 


is. 25) 


This  principle  may  be  realized  using  such  systems  as  that  expressed  by  the 
principle  concained  in  (4.28)  which  was  obtained  for  a  channel  without  fading, 
the  only  change  being  in  the  functional  transformations  and  the  magnitudes  of 
the  thresholds.  For  active- interval  systems  15.25;  reduces  to  the  inequality 

r.,.r,  (5.24) 


which  coincides  with  (4.5U).  Therefore,  for  act i vo- interval  systems  the  decision 
circuits  under  conditions  of  slow  Rayleigh  fading  are  the  same  as  in  the  absence 
of  fading. 

The  probability  of  error  in  the  case  of  such  reception  principles  is  com¬ 
puted  as  the  probability  of  nonfulfillment  of  inequalities  (5.25)  or  (5.24) 
if  signal  z^(t).  We  will  compute  this  probability  for  an  act i ve- interval 

system,  assuming  that  all  signals  z  ( t ) . z^ (t )  are  mutually  orthogonal  in  the 

i ntei  si f l ed  sense . 

We  can  easily  see  that  for  all  Rayleigh  fading  all  values  of  V  have  a 
Rayleigh  probability  distribution 
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which  coincidi.s  with  previously  obt. lined  lornu! 


i  .  i  i 


Such  :>  result  iln'ui.1  be  expected  i  na*-  mi  i,  ,is  in  tb.e  case  >f  in  oheront  re - 
cert;  on  of  signals  with  an  a  tier  interiai  the  uhn"-  of  ch.inne  ’  -.ir  tret  ev<  de 
not  affe  t  the  decision  •-  ys  t  on .  lhe  case  is  otherwise  with  *•  i  g  Is  hav  ing 
different  power  levels  when  the  iIiwuor  principle  "vnressed  in  I  -J .  0  h  ,  which 
was  obt  ni  n«*ii  inuier  the  assuirpt  i  on  that  the  t  fans;-]  sss  on  coefficient  i  *•  Inowr., 
differs  greatly  frar  the  prtneiple  expressed  in  !  .  J  .'  1  which  was  Jr  duo  f  r  a 
random  transr.  ssmn  coefficient  ,  about  which  is  known  onlv  that  it  hi'  a 
Rayleigh  -  rohability  distribution  md  i  r  ran  -  sipia  re  value  e«p;.il  to 
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We  will  explain  this  by  citing  the  ease  ef  a  binary  VI  s  y  s  t  eni .  There 
he  optimal  incoherent  decision  principle  (•!.:>  CM  in  the  case  of  a  known  trims 
m.ssion  coefficient  leads  to  a  circuit  with  a  threshold  device  in  which  the 
threshold  level  depends  on  the  magnitude  of  .  Application  of  this  rule  in  a 
channel  with  slow  fading  presupposes  continuous  adjustment  of  the  threshold 
level  based  on  measured  values  of  .  The  probability  of  error  is  determined 
by  averaging  the  dependence  depicted  in  figure  1.1J  with  respect  to  .  .  !  is 

averaging  can  be  done  by  the  method  of  numerical  integration  and  the  curvi  ■ 
shown  in  figure  S.l>  were  drawn  on  this  basis  (curve  11. 


If  the  transmission  coefficient  is  considered  unlnown,  then  based  on 
(.“'.del  the  decision  principle  (registration  of  symbol  v  ^  correspond  i  ng  tv'  "so 
is  obtainevl  in  t Me  following  form:’ 
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Here  the  right  side  represents  an  unsgulated  threshold  level  the  ragnitudo 
which  is  determined  by  the  average  mil  net  instantaneous  power  of  the  >.g 
a.d  the  interference  spectral  density.  With  such  a  decision  principle  tl. 
uability  of  error  in  Rayleigh  fading  may  be  expressed  m  final  form  and  i 
equal  to 
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figure  S  •  9  •  b  robab  I  1  •  ;  o'  [rrr  r  ‘  ••  a  Bi-an  *'<T 
System  ie  pi(>  C  ise  of  f-.iyieiah  Fun  r  c,  .  1,  Known 

.ullues  of  (incoherent  recent  i  O'- i  ;  2,  W  :  t  “  i  clii'wi' 
vjlucs  nf  tl"d  1  i  nci'Ferpnt  reception';  3.  ^  i  t  h 
■vnown  and  I  coherent  rrciT!  :nr'|  . 

Ihis  dependence  i'  also  e>pres  <  ,1  n  J  i  gun  a .  9  u  nvr  Ji.  Ihus,  the 
a!  sence  of  ini  rmatier,  abc  :t  tfu  ms:  ini  .inems  v  if:  !  the  transmission  co 

efficient  increase  -  the  ;  ivl  abi  I  .  r ■  f  error  -.rwh  it  .  fun e  a  in  the  <aro 
figure  is  drawn  iron  t<  rrul.i  >  fr  c  ’‘on  nt  re,  ’  i  r. ,  i.e.,  und«  r  the 

issumptior.  that  the  i  n<:  mt  ire  a  lines  ;  i  h.'i  as  ;  ■  are  known. 


Uc*  mil  also  consider  a  binary  system  v*i  tn  an  act  i  ve  interval  in  the  case 
of  nonorthugona  1  signals.  since  tor  active-delay  svstems,  knowledge  ot'  the 
transmission  coeffi  cient  .  does  not  affect  the  decision  system,  it  is  com¬ 
pletely  obvious  that  with  unknown  values  of  ..  the  probability  of  error  is  ex¬ 
pressed  by  formula  (.5.19J.  Nevertheless,  we  will  present  the  deduction  of 
this  formula  based  on  decision  principle  1 5 . 24 ) ,  inasmuch  as  this  example  will 
lie  used  to  demonstrate  several  methods  of  computation  useful  in  the  investiga¬ 
tion  of  more  complex  cases. 
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ill  rewrite  principle  (5.2-1)  as 
symbol  is  registered  in  that 


applied  to  a  binary  system 
case  when 
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(5.29) 
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represent  normally  distributed  random  variables.  The  random  variable 


t . 


•V, 


Y  ,  ~'X\ 


(5.30) 


represents  the  quadratic  form  of  normally  distributed  variables. 


fhe  probability  of  error  can  be  computed  as  the  probability  of  nonfulfill¬ 
ment  of  inequality  (5.091  when  signal  (t)  is  transmitted 

P  -!»«;,(/)  }-«(/)}.  (5.31) 

for  this  purpose  we  will  find  the  characteristic  function  of  variable 
from  which  it  is  possible  to  determine  its  density  and  compute  its  probability 
(5.31).  In  order  to  use  this  method  in  other  cases  we  will  demonstrate  how  tc 
find  the  characteristic  function  of  random  variable  i.  expressed  in  quadratic 
form  of  an  arbitrary  number  of  normally  distributed  variables  x, .X- , . .  .  ,x_ 

1 9  1  *  1  “n 

with  zero  mathematical  expectation: 
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tipi 
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whore  i.  =  i  ,  are  actual  constants  defining  quadratic  fonts, 
kp  pk  ■ 


An  aggregate  of  normal  variables  with  zero  mathematical  expectation  is 
unambiguously  described  by  a  2n  >  2n  correlation  matrix 


K  |i.\,  x  ,,h  k.p  I , .  .  In. 

where  the  horizontal  line  indicates  statistical  averaging. 


(5.33) 


It  can  be  shown  [Sj  that  under  these  conditions  the  characteristic  function 
v(v)  of  random  variable  '  is  equal  to  (see  Note  4  to  this  chapter) 

l 


Old 


n  c 

*  -i 


(5.34) 


where  represent  the  eigenvalues  of  matrix  KA,  i.e.,  the  roofs  of  the  equation 

f K A  - I (  0.  (5.35) 

A  is  a  2n  ■  2n  square  matrix  (5.32); 

A -{•»„). 

I  is  a  2n  '  2n  matrix. 


Solving  equation  (5.35)  we  find  values  of  and  determine  the  characteristic 


function  b(v)  by  knowing  which  we  are  able  to  find  the  distribution  density  of 
the  random  variable; 

/. 


cf;|  ■  J  0  (.")  <xp  (  -i  c;)-/:’ 


■’  -i  II  c- 


(5.37) 


The  integral  obtained  usually  (although  not  always)  can  be  computed  using 
the  residue  method. 


Ke  will  use  the  method  described  to  find  the  distribution  density  of  random 
variable  ■,  (5.30)  [6].  Assuming 


he V, (/).,'  ^.(O-l-zMO. 


where  u  and  y  in  the  case  of  Ravleigh  fading  are  normally  distributed  varia- 
OS 


bles  with  zero  mathematical  expectation,  it  is  easy  to  see  that  X^,  ,  X^,  and 

also  have  a  normal  distribution  and  zero  mathematical  expectation.  It  is 
easv  to  find  their  correlation  matrix; 
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i'erformi  ng  ir.u  It  i ;' !  i  v  .it  i  mi  of  mat  rices  and  substituting  ill  t  he  i  r  va  ltu  <  wo 
obt  1 1 n  the  equat i on 

|(-  (\  !  I )('»'•■’  (  Ii  -c ;  I)  !  i-m'i'1  •  I)  !• 

I  c'i'  !  ;  I)'|  I  |  I) 


I  p’)  —  (/;"  j  1)1 1  -  p’ )J ’  0. 


Solving  this  equation,  we  find  its  four  roots: 


(5.4U) 


i  'v(i  /) 


Ml  y) 

t  :  t h%  j  l)(l  pi  •  K  V  K  K 


(5.41) 


Inasmuch  as  the  roots  are  multiple,  the  characteristic  function  (5.34)  of 
variable  is 


'(I 


and  its  distribution  dens: tv  i.3.3~i 


i  f  <■■[(  ,.n 


\  (.  v  ii 


(5.42) 


lo  compute  the  probability  of  error  we  are  interested  only  in  the  value  of 
.  I  ■’  i  in  the  case  when  _  0.  i.ons  i  de  r  i  ng  that  when  •'  ■  0  and  1m  -  D  the 
integrand  when  *  *  approaches  zero,  and  by  using  the  .Iordan  lemma,  we  may 

assert  that  this  integral  is  equal  to  the  sum  of  the  residues  of  the  integrand 
at  the  poles  of  the  upper  semi -plane  multiplied  by  2 - i .  In  the  giv >n  case  the 
integrand  has  two  poles: 


i'ut  ,  as  is  apparent  from  t.5.4!  -,  •  0  and  ,  0.  therefore,  on!)  pole  , 

lies  in  the  upper  semi-plane  of  the  cornplo  plane  and  the  residue  at  this  point 
is  equal  to 

f'V  (-  '•  d 

m  Ml  /,  •,)  ’ 


I  bus,  when  0 


A 

-  r  s  •  * .  > 


1 5 . 4  3) 


It  follows  that  the  probability  of  error  is 


H"-  m  J-'K.V-)-'1  '.  'd 


(5.44) 


5  *4  #  "  <1*  !  ft  5  Ih.<*  -i  : 


f  \tv. 


: ! 


:  .ii  ii 


•  i  i 


«#«;*!»  koitu  iiic*  u  i  5  h  '•.J‘.* 

*»<•  Kii;  ;:j?  .»’m-  uj  in  Jet. ul  *  he  m  i*p  ? 1  or.  u!  signals  with  unlnown  \  -i  1ms 
!  .*»  4  sn  'he  »  I'-r  !  .pi.i s :  ■  lt.»i  le i  git  fading.  In  work  [9]  .t  decision  prin- 

•  s  ;  J  '•  ande  !  ‘he  .i  s  sur.p  t  i  .  r  th.it  the  !  i  (Ml  !  ,t  I  i opponent  I’t  thr 

s  r  .iti>c  i  •>  •>  i  o.'i  k  ue 1 !  i ».  i  it.  t  .itnl  tlu'  phase  of  tin-  regular  component  are  knuwn. 

Ihe  ratio  I. "  between  t  hr  powers  of  tlu-  regular  .iiul  fluctuat  ing  components  is 
also  assumed  to  hr  known.  \  simpler  decision  principle  is  oht.unei1  there  under 
the  assumption  that  all  values  ot'  phase  shift  are  ei|U  i  prohab  le  . 


lor  act i vc - 1 nt e r\ a  1  systems  this  principle  is  greatly  simplified  and  reduces 
to  the  condition 


l  l  ( '  I .  ei  f  /  /) ,  (S  4S J 

which  coincides  with  the  optimal  incoherent  principle  for  channels  without 
fading  and  with  Rayleigh  fading.  In  this  case  the  probability  of  error  in  the 
case  of  orthogonal  signals  coincides  with  (5.16). 

be  will  point  out  that  the  decision  principles  described  ii  this  section 
are  optimal  also  for  that  hypothetical  channel  in  which  the  transmission  co¬ 
efficient  „  changes  by  jumps  when  there  is  a  shift  in  signal  element  and  re¬ 
mains  constant  for  the  length  of  an  element.  Although  such  channels  do  not 
actually  exist,  the  idea  is  suitable  for  use  in  Section  r>.4. 

Reception  with  an  Unknown  Fading  Law 

In  actual  practice  the  distribution  of  probabilities  of  a  transmission  co¬ 
efficient  in  a  fading  channel  is  often  unknown.  In  some  cases  it  may  differ 
greatly  from  the  usual  and  generalized  Rayleigh  distribution.  If  fading  is 
very  slow  and  it  is  possible  to  measure  i.  and  b  continuously  and  with  sufficient 
ac’uracy,  lack  of  knowledge  of  the  law  of  fading  has  no  effect  on  the  structure 
of  the  decision  system.  However,  as  already  noted,  the  need  to  evaluate  ;.  and 
')  greatly  complicates  a  receiving  de/ice.  Therefore,  obtaining  a  decision 
principle  for  that  case  when  the  values  of  ..  and  o  are  not  known,  and  even  their 
probability  distributions  are  not  known,  is  of  interest. 

One  possible  way  to  construct  such  a  principle  is  to  use  the  generalized 
criterion  of  maximal  likelihood  [10J.  I'or  the  case  of  fading  at  a  zero  rate 
we  will  consider  that  in  the  reception  of  a  certain  signal  clement  a  and  0  are 
constant  (not  random)  but  unknown  parameters.  According  to  the  generalized 
criterion  of  maximal  likelihood  [llj  of  several  hypotheses,  that  one  is  selected 
for  which  the  maximum  of  the  likelihood  function  is  greater  than  for  all  re¬ 
maining  hypotheses  and  the  maximum  pertains  to  all  unknown  parameters. 
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signal  i.  thus  has  tlu-  uri’.it  i-s  t  maximum  of  likelihood  luiu:  a  .1 

/•,  ■  r.  {'  '• 

which  is  tlic  rule  for  registering  symbol  Jj  based  on  the  cr j tor  i  on ol  n,i.\:::..il 
likelihood  when  the  fading  law  is  unknown. 

for  active- interval  systems  when  I’ .  T  this  principle,  as  night  be  i.\- 

pected,  coincides  with  (,s.J4)  [10]  and  dues  not  depend  on  whether  the  fading  I.iw 
is  known.  As  far  as  the  probability  of  error  when  using  a  decision  system 
based  on  (,5.2-lJ  is  concerned,  it,  of  course,  depends  on  the  probability  dis¬ 
tribution  of  ... 

5.3.  Memory  in  a  Channel  with  Slow  Fadi  >g .  Several  Problems  in  Coding. 

In  the  preceding  section  the  probab i  1  i i i os  of  incorrect  reception  of  a 
signal  element  were  computed  for  different  communication  systems  when  fading 
occurs.  A  comparison  of  these  results  with  those  obtained  in  Chapters  ill  and 
IV  (no  fadingj  shows  that  the  probability  of  error  in  a  fading  channel  (es¬ 
pecially  in  the  case  of  Rayleigh  fading.)  greatly  exceeds  the  probability  of 
fading  in  a  channel  without  fading  when  the  ratio  between  average  power  of  a 
signal  and  interference  spectral  density  remains  the  same,  lor  example,  in 
order  to  provide  a  probability  of  error  on  the  order  of  10""  in  the  case  uf  in¬ 
coherent  reception  in  i  bina-y  orthogonal  system  with  an  active  interval,  it  is 
sufficient  to  have  !r  ^  IS  in  a  channel  without  fading  and  lr  *  10,000  in  a 
channel  with  Rayleigh  fading 

However,  it  should  not  be  thought  that  a  channel  without  failing  in  the  case 
where  lr  =  10,000  will  be  equivalent  in  fidelity  of  reception  or  in  carrying 
capacity.  The  fact  is  that  a  channel  without,  fading  when  the  interference  is 
approximated  by  white  noise  is  (in  the  discrete  representation)  a  channel  with¬ 
out  memory  while  a  channel  with  <low  fading  is  a  channel  with  memory  and  this 
memory  encompasses  a  larger  number  of  elements,  the  slower  is  the  fading. 

Thus,  the  probability  of  error  computed  for  a  channel  without  fading  does 
not  change  if  it  is  known  how  the  preceding  signal  elements  were  received.  In 
a  channel  with  slow  fading  the  probabilities  of  error  computed  above  are  only 
unconditional  probabilities  which  may  differ  greatly  from  the  conditional  pro¬ 
babilities  of  error  if  the  result  of  reception  of  one  or  several  preceding 
elements  is  given. 


|(\  wo.  o  t  o  \  i  nip  i  i  we  will  s  ur;  |  u!  e  Mu  >.  oi.d  i  t  .  un.i  i  ;  i  ul  .1!  1  1  1  t  .  <  *  1  -Mi! 

iiuihofor.t  reception  ol  .1  s!i;ii.il  »•  I  •  r-u-n  t  111  .1  i  1  it  huge  :..i  i  .li'lif  into: 

sjvlt'i;,,  v  'IimJi-iuii:  mils  tin-  result  el  leiiptiti.  u!  ■in-  p  iv  .  ed  1 ::  1.  -  1 1:  n  .1 1 

»•  I  einoli  t  .  In  Su  .Lung  t !  1  •  fading  .>  1  1  1  !r  v.  «i'i‘  .  del  1  d  i  i.ieigt.  .  1  n  i 1  o  ■■  li'U  tin 

t  hi  >1  in  .nlt.Ki-nt  signal  eltv.ont  will  be  :  r.n-t  w.il  h  tin- 

Wo  i»  1  1  !  assume  tli.st  .  1  p  ivced  1  ng  .ir.n.i!  ileit.enl  is  rru'iu';!  ijitis'IIi. 
'hvi  oils  i\  ,  the  condi  t  1  i’ll.!  1  p  robab  1  I  1  t  ■.  . 1 1  iiuorre.t  :  o.  opt  i  on  the  no.'.!  tv 
rnvn  t  is 

r 

" 1  1  ik  or  1  or  1  \  ;  (incur  1  1  cor'd  , 

w tie  re  piincor  ..  I  is  tin-  cu'idi  t  i  ona  1  p  robab  i  I  i  t  y  <>t  eiror  for  .1  certau.  \;il;u 
.  anu  .  (...  corj  i :.  the  toiul  i  t  i  011.1 1  tk-iiMiy  .>!’  probability  of  .  it'  tilt  piece. 
1  t*i:it*n t  was  rece  r.  tv!  cor  re  *.  i>. 

In  tint!  .  (,.  curl  wo  use  the  haves  i’on:u...i 


w(..  cur)  -- 


( -.)  p  ( cu  r  .. ) 
p(cor ! 


p(corv.)  -  1 


1  t 


"  h.  ' 


is  the  probability  oi'  correct  reception  with  a  given  value  ci 

PCcorJ  =1  h  '  . 

is  the  unconditional  probability  ol  correct  rect  |<t  i  on . 
Substituting  ...  (...)  from  (5.3),  we  obtain 


Q  A’>  '  •*  l1 


n-b'.'  cor)  r 

•wl-  y  l!  1  1 


Whence,  considering  that 


we  obtain 


p(incori'e)  '  f —  ,L'  /,'  \ 

V 

p(incor'cor)  ’  [  '  f  “ ’  /ixij  /  | 


I) 


1 

When  h“  ;•  1  this 

tional  probability  of 


conditional  probability  of  error  is  3/4  of  the  uncondi- 
error . 


Similarly,  we  can  compute  the  conditional  probability  of  incorrect 
of  an  element  if  a  preceding  element  is  received  incorrectly. 

,  i<  [  i  v 

p  (incor j incor) 

M 


rccept i on 


(-5.54) 


With  an  increase  in  h“  from  :er )  to  infinity  the  conditional  probability 

p  (incor | incor)  decreases  from  0.5  oniv  to  0.25.  Therefore,  even  with  a  very 
great  preponderance  in  signal  over  interference  the  probability  of  error  is 
great  if  a  preceding  element  is  received  incorrectly.  Consequently,  in  such  a 
channel  errors  will  with  great  probability  be  grouped.  With  an  increase  in 
signal  power,  these  flashes  or  packets  of  errors  occur  more  rarely  but  the 
average  duration  of  a  packet  changes  very  slowly  and  depends  mainly  on  the 
average  period  of  fading. 


As  already  noted  in  Chapter  11,  this  c. rcumstance  must  he  taken  into 
account  in  the  selection  of  a  correcting  code.  Such  a  code  in  a  channel  with 
slow  fading  must  permit  detection  or  correction  of  a  pacKet  of  errors  which 
are  longer,  the  slower  is  the  fading  in  the  channel.  One  of  the  simplest 
methods  (although  far  from  optimal)  is  construction  of  a  code  providing  for 
decorrelation  of  errors,  i.e.,  such  an  arrangement  of  symbols  entering  into 
a  general  parity  check  that  they  are  separated  by  time  into  intervals  which 
exceed  the  time  of  correlation  of  fading. 

We  will  consider  by  way  of  example  conditions  under  which  use  is  made  of 
the  simplest  binary  correcting  codes,  i.e.,  the  three-element  code  of  (3,1) 
which  permits  correcting  one  error.  Such  a  code  amounts  to  repeating  every 
signal  element  three  times  and  registering  the  one  that  occurs  two  out  of 
three  times.  In  this  case  uncorrected  errors  will  occur  in  that  case  when  at 
least  two  elements  are  received  incorrectly. 


We  will  assume  that  such  a  code  is  used  without  decorrelation  of  errors, 
i.e.,  all  three  elements  of  a  code  combination  are  transmitted  one  after  the 
othe  •.  We  will  consider  the  fading  to  be  so  slow  that  u  changes  practically 
not  at  all  over  the  length  of  three  elements.  Let  the  coefficient  of  trans¬ 
mission  u  adopt  a  certain  value.  Then  the  conditional  probability  of  incorrect 
reception  of  an  element  (incoherent  reception  of  signals  which  are  orthogonal 
in  the  intensified  sense  is  assumed)  is  equal  to 

p  »  p(mcor|u)  =  ..  exp  —  ■ 

V  ei  -  > 
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The  conditional  probability  of  an  uncorrected  error  in  a  combination  con¬ 
sisting  of  three  elements  is 


p(incor|p)  /<’  -  ;>)  '\p:  -2  />'  • 

3  /  i-’  .  ?  '■  (  3  k  .  •>  \ 

-  r:K\ 


(5.55) 


Averaging  this  expression  with  respect  to  u ,  we  obtain  for  Rayleigh  fading 


p  (incor) 


(5.56) 


2  2 
When  h"  >  1,  this  probability  is  approximately  equal  to  5/6h ^ ,  i.e.,  only 

l7°o  less  than  the  average  probability  of  error  in  the  case  of  primary  coding. 

If  we  consider  a  code  combination  as  one  element  of  duration  three  times  as  long, 

then  h“  increases  by  three  times  and  the  probability  of  error  will  be  approxi- 
matcly  equal  to  1  / 3h ^ ,  i.e.,  to  2.5  times  less  than  5/6hg.  Refraining  from  in¬ 
terference-resistant  coding  and  maintaining  the  rate  of  transmission,  it  is 
possible  to  triple  the  length  of  a  signal  element.  Thus,  the  use  of  a  code 
(3.1)  without  decorrelation  in  a  channel  with  slow  fading  does  not  increase  but 
decreases  fidelity  of  reception. 

In  the  case  where  we  use  the  same  code  but  with  decorrelation  of  errors, 
the  probabilities  of  incorrect  reception  of  elements  entering  into  a  code 
combination  are  independent  and  are  determined  by  expression  (5.17a).  Then 
the  probability  of  an  uncorrcctcd  error  is 

p  (incor)  3/>;  •  -  2/>’ - 

1  (5.57) 

_ _ a  ___  ;  _  M.;  f  i 

T  f  (C-  *  V  ’ 

in  the  case  where  >•  1 

4 

pOncor)  %  3/hfl, 

i.e.,  it  is  significantly  less  than  l/3h^. 

Thus,  in  the  case  of  decorrelation  of  errors  in  a  channel  with  slow  Rayleigh 
fading  code  (3.1)  yields  a  significant  increase  in  fidelity  of  reception. 

In  the  more  general  case  it  is  necessary  to  compute  the  probability  that 
with  reception  of  an  n-element  code  combination  there  will  be  k  errors  (k  •_  n) 
[12].  Specifically,  in  many  cases  the  probability  of  error-free  reception  of 
an  n-element  code  combination  (k  =  0)  is  of  interest. 

We  will  assume  that  the  fading  is  Rayleigh  in  nature  and  so  slow  that  the 
transmission  coefficient  ..  changes  practically  not  at  all  over  the  length  of  n 
elements  of  a  code  combination.  The  probability  of  correct  reception  qn  ( ..  ) 
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ot'  ail  n-element  code  combination  with  a  given  value  ol’  .  for  a  binary  system 
with  an  active-interval  orthogonal  in  an  intensified  sense  is  equal  to 

|l  /‘(a*)’.  I  a  -  3  s  i 


where  p(.-J  is  the  probability  of  error  with  a  fixed  value  of  .. 

I  (  i*-;  \ 
f  I  \p  f I 


V  I 


■\ve  raging  (.5.5SJ  with  respect  to  ..  we  find  the  probability  q  ot  correct  n  cep 
•ion  of  the  entire  n-element  combination  with  slow  Rayleigh  fading: 


J"* 


1  !< 


r 

f’1  f  !•' 

1  (  ,‘r ,  \ 

•MM—  1 

1  -  .  •  M’ 

1*  V.  i‘  . 

[  > 

(a  . 59  I 


v-  ■.  . 

. .  -  ■  i  •  ■  i 

I'ormulu  (S.5yj  may  be  represented  in  a  form  more  convenient  t  >r  computation 
using  an  incomplete  bet  a- funct i on : 


*  \ 


recurrent  forrmilu  easily  ibtainabh*  Iron  la. 5^1  nay  also  be  usrl’ul: 

i  *  .*•  *f,k  ,, 
v',<'  .  *» 


i 


i  n 


'  / 


With  an  increase  .11  the  length  of  code  combination  n  the  probability  ot 

error-free  reception  q  ,  of  course,  decreases.  However,  it  decrease-  much  rerc 
'  ui 

lowly  than  in  a  channel  with  independent  error1-. 


Using  formulas  {5.59),  it  is  possible.  lor  example,  to  calculate  that  when 

h~  JU  and  when  the  unconditional  p rot) am  1 1 1 \  of  error  1 «.  equal  to  1  h*  *  J  * 

'  •l.j’lU  the  probability  of  error-free  reception  of  a  ceJe  combination  ten 
symbols  in  length  is  equal  to  q^  *  0 .  ”9 .  We  will  note  for  comparison  that  m  a 

channel  without  fading,  i.e.,  with  independent  errors  where  p  I.T'-IO  “ ,  the 

probability  of  correctly  receiving  a  ten-element  code  combination  is  equal  to 

q  =  (1  -  p)  =  0. ‘das U  *  0.l5.  It  is  true  that  for  this  it  is  sufficient  lc 

i  ^  -v 

have  h"  '  1.82.  Nevertheless,  it  is  apparent  from  this  that  if  we  compare 
channels  with  respect  to  probability  of  correct  reception  of  relative's  i'ong 
code  combinations  the  existence  of  slow  fading  does  not  impair  the  quality  of 
a  channel  to  the  same  degree  as  when  comparing  a  single  symbol  with  respect  to 
probability  of  correct  reception. 
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\\e  uill  present  one  more  examp  h  to  confirm  this.  Vs  already  noteu,  .1 

probability  ot‘  error- tree  reception  of  a  symbol  o!  p  -  lid"  '  in  the  i  .isr  ol  tr. 
'rthogunal  act  ne-  interval  system  and  incoherent  reception  n  prov  :ded  in  .1 
channel  without  lading  t f  h-  *  IS.  Under  these  conditions  the  probability  f 
incorrect  reception  ot'  a  code  combination  from  among  100  symbols  1 s  appro*  ir  itel 

equ.  1  to  JU  In  order  to  provide  sin.  h  a  probability  ot  error-tree  m-ci  j  t 

one  symbol  in  the  case  of  Rayleigh  lading  it  is  necessary  to  hay e  h“  5  10  . 
i.e.,  the  averagi  power  of  a  transmitted  svrbi  I  must  be  increased  hy  appro*  1 
mately  o.-0  times.  It  it  is  necessary  to  provide  only  tor  a  |  robability  t 
error  tree  reception  ot  a  100  digit  code  vomt  in.it  1  *n  equal  to  1 

h*  '.'Ot  e  sut  tic  lent,  i.e.,  the  pow .  r  ot  a  transmitted  signal  u-.i  1  in¬ 
creased  only  h>  >0  times  to  conpelisa’  e  tor  the  effects  ot  t  iding.  UmSe  t  •  t -it.il.d 
it  is  assumed  that  the  coet  fs .  1  ert  ot  tran-ni-s  ■!'.  changes  pra.ti  .ill  :  t  ,* 

.ill  out  the  length  ot  100  symbols. 

5  .  i.  .  Effect  Ot  Hair  of  Fading  on  Probat)  i  I  i  tv  of  Error 

In  this  section  we  will.,  ,is  i  rmly,  a  sum-  that  tading  1  s;(r.  1*  the 

sense  that  ir.  formula  ( .>.0.1 1  r  .>.«!  ^  gr*  at  iy  *  \  c  •  ml*  the  leni.t*  -  !  a 

-ignal  element  !.  However,  we  will  not  consider  this  p rej ondi ran . e  so  great 
th  t  and  change  practically  not  at  all  over  I.  In  this  i.,st-  th*  d--  ;  1  ■  >r 

c  s 

principle  deduced  tor  t he  absence  f  lading  or  fur  lading  at  .1  cere  rate  will, 
generally  speaiir.g,  be  no  longer  op  tin.  1.  Nevertheless,  w  1 1  ti  tr*pecf  to  sjtw 
tading  if  can  1  e  assured  that  these  dev.sion  ;  1  nu  ij’le*  remain  sut't  1  c  1  ent  1 ' 

close  to  optimal.  I  he  ret  c  re ,  we  will  is  sure  that  incoherent  rc*«  p? 1 <  n  ocius- 

in  a*  c<  nlarice  with  the  rule  determined  1  r  tading  at  a  ;eti  rate  whi  di ,  in 
the  c-ise  oj  1  y  s  t  er.  with  an  ictivi  1?  ter  \  al  o  ir.v  nil's  with,  fit  •;  tim.il  :  r 
.1  .  h.innel  without  fading,  and  we  will  t  r»  1!  only  app  t  <>v  1 -at  e  1  *  ,  1  •  t  iH.ut< 
how  much  the  prohahi  lily  of  ertot  change-*  art  it  1  considered  t h .. t  tfu  m.agr  1 
f  ud  e  of  .  over  time  1  changes  within  -r .  1 ' I  'Huts. 

' » d  so,  let  the  signal  element  Hr  \  e  eived  Hr- 


/'  It)  m.  <H  '•  1,1  I*  < ' 1  '  I 

(I  I  •'  1  .  r  '  n 
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It  is  obvious  th.it  ssribols  ..  and 

*  S 


arc  norn.il  random  variables 


.inasmuch  .is  they  are  obtained  as  a  result  of  a  linear  operation  of  integrating 
gauss  i  an  processes,  lie  will  determine  their  mathematical  expectations  and 
d i spe  rs i ons : 


f 

•  (■.  \  ^  p.iOdt  <>. 

t* 

r 

■  n,  •  |i*. 

r  7 

i».  ’  ! .  j  jn.  < r , i  ••  it  i  tit ,  'it , 


»  i 


-I,)  lit,-'.!, 


vJ.j 

0  "/, 

[jV-  •■  ■■  -  j  j 


{  Writ/.  - 


+  hfci •«./ 


l-'Ho 


)  Kc.w-. 


f  5 . 6  J ) 


( s  .  b .' 


Here  the  exchange  ?  anables  an.!  cons  i  derat  l  on  of  parity  of  correlation  co¬ 
efficient  are  done  as  when  deducing  equation  f-S.901. 

s  i  i  laris  , 


•  T 

I  V*  >  -  l‘d  '  f'  J  (>  ’  ^  /?(-)  »/*.. 


( S  .  b  3  a  1 


•  n-  I  j  i  IM  !•,)  I'd  'it, 

(>  ti 

t  t  -  r  »,  r 

- ' *  J i” 71  J 


(5.  Lob) 


inasmuch  as,  as  was  showg  in  Section  5.1,  R(;)  is  an  odd  function, 
he  will  also  introduce  the  notation 

(0  i»«  (0  •  .  i‘<  . 

A.(0  !*.(/)  -<;i.  (5.0JJ 

Now  a  signal  being  received  (5.t>0)  in  the  transmission  of  r  ^  ( t  I  can  be 
written  as  follows: 

{  <  |»,  .'((/>  ;  <  n.  ■  •'<('•} 

■i  (x  in. MO  ;  d.  10  ?•,(.•)!  ;  «(').  (5.05  ) 

and  we  may  consider  it  as  the  sum  of  the  useful  signal  included  in  the  braces 
where  the  components  of  the  coefficient  of  transmission  remain  constant  over 
0  ■  t  ■  T,  the  interference  n(t),  and  the  additional  term  which  is  included  in 
the  brackets. 

This  additional  term 

&,(0  i  V0-i<0 


rs  a  random  process.  It  arrives  at  the  decision  system  aid,  generally  speaking, 
influences  the  probability  of  error.  But  this  influence  can  vary  greatly  de¬ 
pending  on  the  signal.  In  order  to  explain  this  we  will  consider  two  extreme 
cases . 

a)  The  additional  term  is  added  to  the  useful  signal.  This  occurs  in  that 
case  when  the  coefficient  of  mutual  correlation  between  useful  signal  and  addi¬ 
tional  term  is  equal  to  unity,  e.g.,  in  that  system  where  signals  :r(t)  repre¬ 
sent  very  short  pulses  occurring  at  various  instants  of  time  ^(counting  from 
instant  of  beginning  of  reading  of  a  signal  element).  it  can  easily  be  seen 
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that  under  tlv  -  conditions  the  additional  term  acts  on 
.is  does  the  useful  signal.  Obviously,  in  this  case  the 
expressed  the  same  formulas  as  in  the  case  of  a  zero 


the  decision  system  just 
probability  of  error  is 
rate  of  fading . 


h)  The  additional  term  is  added  to  the  interference.  This  occurs  in  those 
cafcos  when  the  additional  t e mi  is  statistically  independent  of  the  useful  signal 
and  can  be  considered  to  be  random  noise.  A  typical  example  is  provided  by 
the  system  in  which  signal  z  (tl  represent  different  realizations  of  normal 

noise  with  a  uniform  spectrum  in  a  certain  rather  wide  frequency  band  i- .  Then 
• . ( t )  will  also  be  normal  noise  in  practically  the  same  frequency  band.  In 

the  first  approximation  l’T  and  KPT  systems  and  also  l-'K  systems  with  a  small 
spread  of  frequencies  of  adjacent  signals  can  he  relegated  to  this  case. 


Various  intermediate  cases  between  these  two  extremes  art  possible.  Thus, 
the  additional  term  may  be  orthogonal  with  respect  to  all  realizations  of  the 
signal.  Then  its  power  is  subtracted  from  the  power  of  the  signal  but  not 
added  to  the  interference.  Cases  arc  also  possible  when  only  part  c f  the  addi¬ 
tional  term  should  be  assigned  to  interference.  However,  inasmuch  as  wo  arc 
interested  only  in  an  approximate  evaluation  of  the  influence  of  rate  of  fading, 
we  may  limit  ourselves  to  a  consideration  of  case  bl .  The  components  of  the 

transmission  coefficient  for  the  "useful  signal"  -  ..  and  over  one 

c  s 

element  do  not  change  and  may  change  only  in  jumps  at  the  instant  of  element 
change.  \s  indicated  in  the  preceding  section  in  this  case  dependences  oh 
tained  for  fading  at  a  zero  rate  remain  valid.  It  is  also  necessary  to  con¬ 
sider  that  the  power  of  the  "useful  signal"  in  ia.65j  decreased  by  the  magnitude 
of  the  power  of  the  process  .  ( 1 1  which  was  added  to  the  interference. 


i'n  the 

basis  of 

.  tic  1  w  can  c  asi  ly 

see  that  the  average  power  I’j 

uscfti!  signa 

1  in  lo.ts'i 

i s  equa 1  t  o 

/-  /•  '*•  /'*• 

l\,  i*  : 

•  •  T 

where  1  is 
s 

the  initial 

signal  power;  1'  i 

■  the  ratio  between  the  powers 

regular  and 

f  luct  uat  i  r.g 

components;  and  1 

,  s  ,i  dimens  i  <  n  less  magnitude  di 

dent  only  mi  the  coefficient  of  correlation  of  fading  K(‘l  and  the  duration  t 
signal  element  I  an  1  is  equal  te 


r 


U 


in  the  .ase  of  fading  at  a  .ero  rate  when  we  may  assume  Ki-  )  1  ;r.  the  ent  .  re 

inter,  a  1  cl  integration,  from  it  follows  that  1  I. 


Inasr,  uch  as  a  decrease  in  power  of 
finite  rate  of  fading  concerns  only  the 
is  somewhat  increased  and  becomes  equal 


useful  signal  as 
fluctuating  part 
t  o 


a  consequence  1  *  a 
then  coefficient  k 


(S.ftfll 
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Simultaneously  the  power  of  interference  increases  by  a  magnitude  of 
P  (1  -  !.)/]  +  k~  and  its  spectral  density  may  be  considered  in  the  first  approx¬ 
imation  to  be  equal  to 


(i 

i  (i 


n 


-'/J 
/M  l  ■  M 


M  -  /■) 


tv ;  d_  i) 
(i  •  /< 


(5.09) 


where  l:  is  the  frequency  band  accepted  for  the  system;  and  B  -  DPT  is  its  base. 


Thus,  all  formulas  obtained  for  fading  at  a  zero  rate  remain  valid  for 
this  case  if  in  them  we  replace  k  with  k'  and  h^  with  h '  •  where 


K  - 


f\T  IkT 


<*'  r  I) 


(t>  I  /)  /(  _ 

('<■ .  i) 


h.  ~ 


'  I)  !< 


H  ■ 


(*’  i  i)/'  •  :■'!,(  i  /) 


(5 . "0  i 


Specifically,  for  a  binary  orthogonal  TK  sv.,tem  with  a  frequency  spacing  of 
1,'T,  considering  that  B  =  4,  we  obtain  from  formula  (5.1") 


P 


h„(  \  -  I)  ; 


c.xp 


(5.“1 


when  I.  =  1 ,  i.e.,  in  the  case  of  fading  at  a  zero  rate,  this  formula  becomes 
(5.17),  With  a  decrease  in  I.  the  probability  of  error  grows  rather  rapidly, 
especially  with  large  values  of  h^  and  small  k. 

If  signal  power  is  increased,  i.e.,  if  h"  is  increased,  then  when  h"  •  ■, 

in  distinction  from  all  cases  considered  above,  the  probability  of  error 
approaches  not  zero,  but  a  finite  value 

r  1  c  (5.~:i 

’» 

Ibis  result  should  not  be  considered  unexpected,  lading  at  a  finite  rate  amounts 
to  multiplicative  interference  which,  with  a  certain  probability,  can  make 
signal  z  (t)  more  like  another  signal  z^ft)  even  in  the  complete  absence  of 

additive  interference.  This  probability  approaches  zero  when  the  rate  of  fading 
decreases,  i.e.,  1  approaches  unity. 


In  the  case  of  Rayleigh  fading  (k  -  0)  we  obtain  from  formula  (5.~1) 


r 


and  the  limit  which  the  probability  of 
finity  is  equal  to 

lllll  p 


error  approaches  when  hg  approaches  in- 


(5. 72a} 


In  such  a  binary  FK  system  if  the  frequency  spacing  is  much  greater  than 
1/T,  the  limiting  probability  of  error  is  much  less  than  (5.72).  If  B  -  - 

is  substituted  in  (5.70),  then  /,-  fu-LA  and  instead  of  (5.71) 

k  i  1 

we  obtain 


i  i 

K  i  ;  ,  i) 


.X|> 


/I,',  I. 


l) 


(5.75) 


and  with  Rayleigh  fading 

_ l_ 

'  P  (5.73a) 

Here  with  an  increase  in  h“  the  probability  of  error  approaches  cero,  although 
more  slowly  than  in  the  case  of  fading  at  a  zero  rate.1 


Figure  5.10  shows  curves  which  are  computed  from  formulas  (5.71)  and  (5.73) 
for  different  values  of  L  in  the  case  when  B  -  4  and  B  =  '<■ .  The  curves  plainly 
show  that  attempts  to  decrease  the  frequency  spacing  in  FK  systems  should  be 
handled  with  great  circumspection  if  the  rate  of  fading  in  the  channel  differs 
markedly  from  zero. 

We  may  view  ether  systems  in  the  same  way.  We  will  discuss  a  binary  RPM 
system  somewhat  more  in  detail.  We  will  use  the  same  approach  as  in  Chapter  IV, 
i.e.,  we  will  base  ourselves  on  the  fact  that  this  system  can  be  considered 
;  orthogonal  if  we  consider  the  signal  over  the  interval  -T  _  t  *  +  T.  There¬ 

fore,  we  will  perform  averaging  of  the  components  of  a  coeffici^r.L  of  trans¬ 
mission  over  the  indicated  interval,  assuming 


'Strictly  speaking,  the  discussion  presented  above  is  not  applicable  to  an  FK 
system  with  a  large  frequency  spacing.  Here  we  cannot  consider  the  additional 
term  i^(t)  as  interference  with  a  uniform  spectrum  in  a  frequency  band  of  F. 

The  assumption  that  with  sufficiently  slow  fading  the  spectrum  lies  close  to  the 
spectrum  of  2^(t)  and  does  not  overlap  with  the  spectrum  of  other  signals  is 

closer  to  actuality.  Therefore,  the  power  of  process  i^(t)  should  be  subtracted 

from  the  power  of  the  signal  and  not  added  to  the  power  of  the  interference. 

This  pertains  to  any  system  in  which  the  spectra  of  signals  cr(t)  are  far  removed 
from  one  another.  It  can  easily  be  seen  that  based  on  such  an  idea  we  again  arrive 
at  formulas  (5.73)  which,  apparently,  correctly  evaluate  the  probability  of 
error  with  relatively  moderate  values  of  B. 
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of  P  and  T,  then  the  same  probability  of  error  will  be  obtained  in  an  PPM 

system  for  the  same  value  of  P  and  a  value  half  that  of  T  (i.e.,  twice  the 

specified  rate  of  transmission).  We  can  see  this  easily  by  comparing  for¬ 
mula  (5.7n)  with  (. 5 . 71)  and  formula  (5.751  with  (5.67). 

The  values  of  I.  and  M  can  be  computed  if  we  know  the  coeffic.ent  of 
correlation  K(0  of  fading  and  the  length  of  a  signal  element  T.  Specifically, 
if  li  ( t )  is  approximated  by  a  bell  curve  (S.(ic)  ,  then 


'■■-ho 


h-  -C)  •;^1  ■ "') 


In  the  case  when  ■  T  (and  the  approach  used  here  is  applicable  only  to 
this  particular  case j 


S  i  m  i  1  a  r  1  v  , 


I  1 


.W  1 


( a  .  ”  S  , 


(5  .  7Sa ) 


If  it  is  considered  that  under  these  conditions  the  value  of  the  coeffi - 
cient  of  correlation  for  •  =  T  is 


*■"  -(  71)  -■ 


then  the  result  obtained  can  be  written  as  follows: 


1  -M**2[\  -  R[T)\ . 


1  —  L  -  ,  (1  -A>(/)]. 


•'or  an  exponential  coefficient  of  correlation  fa.bd) 

'  -10 


<)  _  »>  * 
“  r  ~  /  • 


I  ■  c 
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1 ....  ...  , 


or  in  the  case  when  I  ■< 


5 1  m  1  1  a  r  1  v  . 


( :< .  'y 


In  an  RPM  system  I and  also  in  other  systems  in  which  tlu  pour!  f  the 
additional  term  •  .  ( t  )  is  added  to  interference  power,  e  .  g  .  ,  If  with  a  snail 

frequency  spacing)  the  increase  in  duration  of  signal  element  1  in  the  case  of 
unchanged  power  does  not  always  increase  the  fidelitv  of  reccpt  i  >n .  With  an 
increase  in  T  the  variable  M  (or  I.)  changes  and  this  can  sometimes  lead  to  an 
increase  in  the  probability  of  error  despite  the  increase  in  h^.  Therefore,  i: 

such  systems  there  must  be  an  optimal  value  of  1  which  provides  tor  the  most 
effective  possible  transmission  of  information. 

finding  an  optimal  duration  of  signal  element  in  light  of  the  many  variable 
factors  is  a  very  difficult  task,  he  will  limit  ourselves  to  a  more  particular 
setting  of  trie  problem  in  that  we  will  find  for  what  value  of  I  the  power  of 
the  sigmal  essential  for  obtaining  a  given  probability  of  error  p  is  minimal, 
for  an  RPM  system  with  Rayleigh  fading  from  (S.Tba): 

i  1  *' r 

/i  - 

II  •  ,'c  I 

Assuming  that  K ( • )  is  expressed  by  formula  (5. be)  and  substituting  the  value  of 

-> 

M  from  (5.DaJ  and  also  expressing  h‘  by  P  ,  we  obtain 


fc  -  t  '  v 
I 


*■  »'  V) 

~  f' 
■f-T  -  — 

’l 


Whence  we  easily  find  the  value  T  =  T  ,  for  which  P.  is  minimal- 

onf  s 


opt  RPT 


(5  SO 


If  =  0.5  sec  (a  rather  typical  value  for  an  extended  shortwave  channel', 

^  _  c,  _  4 

then  with  values  of  p  from  10  to  10  the  variable  1  .  changes  from  1  5  to 

•  opt 

4  msec  and  this  agrees  well  with  experimental  data. 

Tor  an  Fk  system  with  a  frequency  spacing  of  1 /T ,  from  (5. 'la)  ard  (5.'S) 
we  find  in  The  same  wav- 


op  tFk 


•t  1  */’ 


(5.80a) 
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in  the  V.M5C  whore  0.3  <t\  and  p  «  10  *  in  ,  the  optimal  \alur  of  1 

lies  between  lc>  and  -54  msec. 

!t  should  ho  stressed  that  expression  (a. SO)  determines  only  a  rel.itno 
opltwr  which  provider  a  minimum  of  signal  power  for  a  given  probability  of 
error.  the  result  will  be  different  if  the  rate  of  information  transmission 
(depending  on  p  .is  we  ’  i  as  direct  1>  on  1  and  not  probability  of  error  is  given 

5-5.  Carrying  Capacity  of  Channel  with  Slow  General  Fading 

\  fading  channel  amounts  to  a  typical  example  of  a  channel  with  variable 
parameters.  Computing  its  carry i-ng  capacity  in  general  form  is  a  difficult 
task.  At  the  present  time  only  a  few  approximate  expressions  and  evaluations 
[18-22]  have  been  found  which,  incidentally,  are  sufficient  for  cases  of 
practical  importance. 

The  states  of  a  channel  are  determined  bv  the  values  of  ..  and  •  (or  _  and 

c 

..  )  .  by  analogy  with  (2. "4)  and  (2.~8)  it  can  he  shown  [23]  that 

|7  |n..  <n.  (A. SI) 

,  II'  (|»  Oi  *••/■(•'.  O  • 

lor  determining  the  carrying  capacity  of  a  channel  it  is  necessary  to  find 
a  probability  distribution  of  signal  :(t)  such  that  (with  certain  limitations, 
for  example,  a  given  power)  a  maximum  of  expression  (3. SI)  is  provided.  Tim 
is  the  most  difficult  part  of  the  problem. 

he  will  discuss  the  simplest  case  when  the  rate  of  fading  is  very  slow  in 
comparison  with  the  rate  of  transmission  of  a  message,  i.e.,  when  by  analyzing 
previously  received  elements  of  a  signal  it  is  possible  with  great  precision 
to  predict  the  values  of  ..  and  Under  these  conditions,  obviously, 

M*  ,e)  <  I1  (:,:*)  and  the  extreme  terms  of  inequality  (5.S2)  differ  little 
from  one  another.  Therefore,  the  rate  of  transmission  of  information  may  be 
obtained  in  the  first  approximation  by  averaging  with  respect  to  ..  and  •• 
the  value  of  1  which  amounts  to  nothing  more  than  the  rate  of  trans¬ 

mission  of  information  in  a  channel  without  fading  for  given  values  of  ..  and  . 
The  maximum  of  this  averaging  of  rate  occurs  in  that  case  when  sigm1  :(t)  is 
so  selected  as  to  provide  a  maximum  of  I  ..,••)  and  for  this,  as  shown 

in  Chapter  III,  the  signal  with  a  given  average  power  ..P  must  be  gaussian. 

In  this  case  the  conditional  (for  given  ..  and  •■)  the  maximal  rate  of  infor¬ 
mation  transmission  or  conditional  carrying  capacity,  in  accordance  with  (3.84) 
does  not  depend  on  a  fixed  value  of  and  is  equal  to 

!  natura  1  units/sec  (5.83) 

where  P  is  the  emitted  signal  power. 
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absence  of  fading  is  shown  for  comparison.  it  follows  tror.  iigute  3 .  1 tha 

slow  Rayleigh  failing  reduces  the  carry  .  ng  i.ipac.  tv  of  a  i  h.inno !  !  .  :u  t  r,  re 

than  1 7*  .  lor  small  I  T  ratios  the  curves  pricticallv  coiiuido. 

s  n  1 

In  the  case  of  slow  uuas i -  Ray  1 ei gh  fading  .t  is  apparent  that  the 
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a  uniform,  noi  sc  spectmn  it  m.i\  be  written  in  trie  following  i  rr 


-308- 


I  ./ 


t 


I  '■  ' 

1  1  ; 


/  / 


i 

i  • 

« 


f  iV  ,  - 

C  *  c 


.  /' 


/ 

.  // 

/ 

/ ' 


1  5«'f  J 

;  •  i  \  o  * .» • 


;c,pr'’LN-*'lt'  »  .j  ‘ 

'  « t  <  .«  f 


i  f  *  ’  i  !  f .  i  r  «  1 1  r  t  r  <  *  \  \  «■  *  *■  r*  *-  »  f  ^ 

if  •  »»' 


<  •  f 


I  r  *.V*ru.< 


i 

i 


j  j  j  j  •  j  k  f  (  • 


:  r 

» »  ' 


.»u  v  s  j  .1  ;  •  .  ;  «  *  :  *  . 

<•'.  .1 .  ..)•  .  1  ,  *  (  •  :..•••• k . 

•  *  l.  t  :  -Ik  '  f  it  .  •  -  .1%  •  • 

;  ■  ‘  i  .  i >■  ■  t  it  i r*  .  ’  T  i  :  •  , 

•  .  :;j  r-.t;  :  •  t  r  -  • 

-  t .  i  i  ■  .  ■  ..  •  . 1 

if  ",  t  ;■  r >■  •. c*  ■  ,  ‘  •  r  I  I'.n 

.1  r  r '  .  .ip  i  .  •  ■  :  i  %  : 

till  -  p;i  ;  rt.il  !  .i  J  ,  t  i  i  - 


:  .iJ  i  r  .  t. .it.:.-  !  -  .  •  t 

1  .  .i  i  i  .  .in  ’  •  i  > ;  : 

i  t  i  .  1  inr.r  i  '■it:, 


i ;  <  .  * 


!  rw  t  t  ,i  I  1  .  . 
i  r.  in\  k 

,io 


i  ;  nt  ir 


V>  1  « 


:  i ;  i  .  » • 


h.inr.o  I  b.i 
k  <uy  i  v 
ijcncr.i  1 


..i  .  h.mvr  ]  *  i  ! ;  :  “ 

!  1  h.v*  r  i  .i  I  -i  »n  i  uy: 
it  i or.  t  rar.'r;  -  : 

JVi***  ' 


'  •  I  .»  s  < 

MiV 


1 


£  (Sec  Section  > .  1  Ji  the  physical  piiturr  described  of  the  origin  of 
'elective  facing  i>,  of  course,  approstmatc  It  tuv  be  used  cnlv  in  a  rela¬ 
tive!*  sma 1  i  Lilith  of  the  signal  power  spectrum.  Signal*  of  irn  wide  spectra 
also  dtspla*  thr  direct  lv  dispersive  properties  of  the  ionosphere  'or  tropo¬ 
sphere)  in  th4t  the  coefficients  of  reflection  for  scat t erir.g )  depend  on 
frequence  .  The  depth  of  wiir  penrtr4tton  Into  the  Ionosphere  also  depends 
on  frcquencs  ihe  result  of  these  phenomena  lv  th4t  even  in  "s  1  ng  le -pot h" 
channels  the  transmission  coefficient  and  ph4ce  shift  prove  to  hr  non- 
identi.  4!  for  the  different  frcijucno  cocpo.r.ent »  of  -he  signal. 

The  f  4dl  ng  •  s  f  rcv$ucnc  v  relationship  occurring  b  cause  of  the  dispersive 
properties  of  the  medium  is  significantly  ro re  weaklv  repressed  than  the 
relationship  determined  b*  the  interference  phenomena  In  ■'multipath"  channels. 
Thus,  for  caamplc,  in  shortwave  ionospheric  propagation  the  dispersion 
phenomena  cause  perceptible  differences  m  transmission  coefficients  onl* 
for  frequencies  which  differ  bv  tens  of  kilocycles  and  more.  while  in  inter 
fcrence  selective  fading  the  correlation  coefficient  between  the  values  of 
j  are  substantially  less  than  units,  and  at  fires  even  close  to  :rro  for  f  r<- 

quonc*  components  differing  >nl»  bv  hundreds  of  cps . 

Ll_. 

0 

LaJI 

b) 

f i qore  5  1 3  •  t  f  f  pc  1 
Dispersivitv  ond  Hyltipath  f’rcpaoat  i o" 
if  T  ra-vni  lor  of  Snort  Pulse. 

The  difference  between  uispersion  and  interference  phenomena  in  iono¬ 
spheric  reflection  of  radio  waves  may  be  graphically  shown  by  scrutinizing 
the  fransmjssicn  of  a  very  short  (c.g.,  duration  ->n  the  order  of  a  micro- 
scconJl  radio  pulse  whose  envelope  is  shown  in  figure  S.iTa.  figure  5 . 1 *b 
represents  the  envelope  of  the  incoming  signal  in  multipath  propagation.  Here 
the  case  is  illustrated  where  four  ”bf  ors"  of  different  strength  arrive  (each 
of  which  in  turn  is  the  sum  of  several  bears  (figure  '.])).  I ach  of  the  "bears' 
which  have  arrived  has  been  subjected  to  genv  -a  1  fading  because  of  the  inter 
fcrence  of  its  components.  The  difference  in  course  between  these  individual 
components  which  rake  up  the  'beam"  has  a  value  on  the  order  of  snail  frac¬ 
tions  of  a  microsecond.  Therefore  on  the  scale  of  our  figure  thev  arc  not 
distinguished.  The  difference  in  speed  between  the  individual  "beams"  re¬ 
flected  a  varying  number  of  tines  from  differing  layers  of  the  atmosphere  is 
from  hundreds  of  microseconds  to  entire  milliseconds  (in  rare  cases  up  to  t~ns 
thereof ) . 
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mi  the  rdct  of  totis  nt  rr  i  nu  t  o  s  i  slew  that  m  rot  radio  channels  J  .ai.l  l  n>;  has 
i  H.i  v  1  o  t  i;n  dj  s  t  ri  but  n>j vVn»m’r,  the  it  e.tn- square  uhtr  ot  the  transmission 
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changes  which  obey  .in  in-distribution  I  tic  l  di  nt  ■  1 1  \  ,  -<.st  authors  usseit  that 
smcIi  hourly  chaises  art  best  de>  ribed  bv  a  nun.al  logarithm,.  distribution. 
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mo  f  quasi  -Rayleigh  fading.  However,  if  V  -  ],  then 
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ami  the  pr.it  :  i  T  .  t  error  decrease*  only  inversely  proportionally  to  the 

squire  r  ■>  t  t  t  *  i »:  r. .« i  power,  i.e.  ,  much  more  slowly  than  even  in  the  case 
of  Hay  1  e .  gh  t  a.  1 1  . 

J.  |Sce  sect]  >r.  .  J  i  Ihe  r.atriv  method  of  finding  a  characteristic  ftinc - 

t  l  on  of  the  quadrat n  furr.  f  gaussian  variables  was  first  used  in  [8], 


Note  5  was  written  b\  I.  ..  \mlronm  . 
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Matrix  G  is  symei  ri  c.i  I  inasmuch  as  matrices  h  it:.:  \  tie  -  rn.net  r  i  v ,» 1  .  In 
tins  case  there  is  a  linear  transformation  fit  variables  v  which  transforms 

quadratic  form  xGx  into  canonical  torn,  i.e.,  into  .  sir  of  squares  (31].  ' 

linear  orthogonal  transformation  is  a  t  ram  format  i  r. 


1  0,». 


(5.  10.' 


when 
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(5.11-1) 


where  g  i  -  m  e  iemenl  of  matrix  u  standing  at  the-  intersection  of  the  k-th 
row  and  l  - 1 1;  co  1  man . 

Iron  condition  (5.1  US,'  i.  follows  that  elements  of  matrix  Q  must,  further¬ 
more,  satisfy  the  following  equation: 


V  1 

«  *et ..  \  . 


:'0 


which  ero. ides  for  meeting  the  requ i  r.  u.ent  of'  orthogonality  and  norma  1  i  r.  i  ng  a 
1  i  n-  ar  f  rails  1  r".at  l  >n  . 


!  Miallv,  tf.e  e  i  cer.v  a  1  aes  ,  of'  mat  i  a  \  U  are  found  as  solutions  of  tht 

r 

ha r  a.  t  e  r  i  •- 1  i  c  eau.it  i  on 

|(i  >  f  n 


'  :■ ,  1 1  m 


‘hiking  the  indicated  t  ran  - 1  u  prat  i  •  n  -  ,  w  find  that  the  multiple  integral 
in  .  1  L't>  ie.or---.  tin  rivdact  t'  're!'  ti^r.ic- 

l 


« (  ) 


t  '-r  \  ,k 


'  \\  fa. 

(>)'»  K  11  J 
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i  he  integral  ftet  ti'.e  product  -yr.}  .  . 

■ht  a  i  r. 
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t  ihular  and,  computing  it  ,  wo 
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•miuc  the  determinant  of  the  ::.itr:x  :>  i  in  inant  in  the  case  of  an  ortho¬ 
gonal  linear  t ran< format i on , 


IV  |<ij 

fecal  lira;  (5.  Ip!  and  substituting  in  i  5  .  1  i  s  '  .  m-  hav 


(5.119) 


v  e 


() 


i5. i :ui 


It'  is  known  that  a  determinant  of'  i  product  of'  two  square  matrices  is 
equal  to  the  product  of'  the  determinant  ,  i.e.: 

‘Ml-  ' 

II  K  \ 


( 5 .  i :  1 1 


since  matrix  KA  is  real  and  symmetrical,  it  is  possible  to  select  a  new 
orthogonal  linear  transformation  i)  which  will  make  it  diagonal.  Using  the 
invariance  of  the  determinant  to  such  a  t  rails  format  i  on  ,  we. have 


»(•)  = 


|y  '(I  VI.KMU,1'  IQ-’IQ  :\.Q  'kaq;' 


(5 . 122} 


Q  'IQ  Q  'Q  I. 


(5.123) 


and  matrix 


Q  'K\Q  \  (*.  p  i.  ?.  ...  2/,) 


( S  .  1  2  4  j 


is  d  i agona J ,  so  that 


H-  fffVAi*'*  —  n  (i  ?«:■>»)' 


Thus,  wo  finally  obtain 


b  - 

n  a 


where  •.  are  found  as  roots  of  the  equation 


|K  \  —  >.|[  •  o. 


which  is  what  we  wanted  to  find. 


(5.125) 


.  (See  Section  5.2}  Many  problems  in  computing  the  probability  of  error  in 
the  case  of  slow  Rayleigh  fading,  e.g.,  by  the  method  described  in  the  preced¬ 
ing  note)  are  solved  much  more  simply  than  the  same  problems  for  the  case  of 
which  fading  is  absent.  If  a  system  with  an  active  interval  is  considered, 
by  knowing  the  probability  of  error  in  the  case  of  Rayleigh  fading,  it  is 

possible  to  calculate  the  probability  of  error  p^  without  fading  by  using  the 

method  suggested  by  N.  P.  Khvorostenko  [14],  On  the  basis  of  (5.S)  in  the  case 
of  Rayleigh  fading 


We  will  set  x  =  h“  and  S  =  ]/h~.  Then 


/’ft-) 


Of 


(5.126) 


(5.127) 


whence  it  follows  that  function  p,(s)  is  a  Carson-Lap lace  transform  of  function 
Py(x)  [ 3 2 J .  It  follows  that  by  knowing  the  "image"  P ( s J  it  is  possible  to  find 
the  "original"  p^ (x J  by  methods  of  operational  calculus  and  using,  for  example, 
the  lleavyside  expansion  theory,  the  Rieman-Mel lin  conversion  formula,  etc. 

Finally,  in  most  cases  p  (x)  can  be  found  using  one  of  the  many  reference 
books  on  operational  calculus,  for  example  [ 3 3 J  . 
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Thus,  from  formula  (5.17a)  for  a  binary  orthogonal  system  wo  haw 


and  from  a  reference  book  we  can  easily  !  i  rul 

i 

t 

/■.(')  1 

or 

r, 


Thus,  from  formula  [5.  I'd)  which  can  easily  be  deduced  iron  a  cor  rhiliin 
matrix  (see  pp.  354-557)  it  is  possible  to  obtain  formula  l.f  1  more 
than  was  done  in  Chapter  IV. 

b.  (See  Section  5.3)  In  many  works  (e.g.,  [54,  5r>])  thv  pr  y  b.iiu  1 1  l  y  >l 
error  is  calculated  in  the  case  of  joint  a -turn  of  inter  'rreiKt  (usual  I . 
Rayleigh)  and  absorption  fading,  i.e.,  fluctuations  «>l  a!  ■>  i;  t  i .  :  n  t*i  •<  .: 
in  which  the  signal  is  propagated,  \arious  distribution  law  air  mi, ti  ! 
for  absorption  fading  and  most  frequently,  as  already  indua  ed .  t).  •>  i-.ii 
logarithmic  law  and  sometimes  the  m-di  st  r  ibat  i  on  law.  In  this  v.is.  :  s  :•  t 
considered  that  the  rate  of  even  exceedingly  "slow”  in  tin  sinw 

interference  fading  is  usually  several  tens  of  orders  groan  i  tha:  t’.e  •  it' 
absorption  fading.  Inasmuch  as  the  average  probability  ot  correvt  re.ep'ioi 
of  a  symbol  is  calculated,  such  a  consideration  is  not  necessary  .  Howevi  ,  ; 
cannot  but  be  noted  that  such  an  "average"  probability  ot  err.  r  Jiara  t  r;a  • 
a  channel  no  better  than  the  average  temperature  o'  a  i  .ii.  uw:  a  non.  :  u 
years  characteri  :es  liis  state  of  health. 


The  average  probability  of  incorrect  reception  ot  a  symbol  ;s  a  ust  t  .. 
(although  not  completely  so)  characteristic  of  a  fading  channel  on!>  in  that 
case  when  thi^duration  of  a  finished  (in  sense)  message  being  tratisnitted 
exceeds  the  average  period  of  fading.  In  this  case  it  permits  evaluating  the 
expected  number  of  incorrectly  received  symbols  in  a  message,  lor  a  snore  com. 
plete  characteristic,  as  already  noted  in  Section  5.3,  how  errors  are  grouped 
in  a  channel  should  be  indicated  and  this  is  determined  In  rate  of  fading. 
Such  a  situation  usually  occurs  in  the  case  of  interference  lading.  Ihus, 
in  shortwave  channels  i,  fluctuates  within  limits  of  several  tens  ot'  fraction 

of  a  second  to,  several  seconds  while  the  transmission  of  a  finished  message 
usually  lasts  not  longer  than  several  tens  of  seconds.1  Similar  relationship 

Mf  a  shortwave  channel  is  used  for  the  transmission  of  very  short  messages 
(e.g.,  commands  in  a  telecontrol  system),  the  average  probability  of  error  dm 
to  interference  fading  los^s  practical  meaning.  It  is  necessary  to  compute, 
instead  of  it,  the  probability  of  distortion  of  a  command. 


-319- 


^ . ... 


B I  Bl  I  OQ.RAPHV 


i  c\  l  n  ,  I' .  K  .  ,  .  .*•.  ‘  ..  .  • :  :  ■  r  .  .  •  •  •  •  ■ 

[  Ihooret  1 1 .» 1  I  unH.irr.ciit  .1 !  s  ut  ivt  ...il  k’.uliu  I  o.  tic ■. o£>  j  ,  \  !.  1 

i'i  si.  iv c  r.iJu  "  I'ri’s*. ,  1  y o <j 

''Au'ol,  h.  i\ .  ”Ihi-  I  ,><J  i  n  >.  >t  k.iiJ'  u!  "i-.lsur  v  .1  Mi,1  1  n 

HI!  ,  it.  ' .  •-  .  :  : .  1 . 

i  I  w»  h.t:i  •  , 

1  l’  l  l  I  .  I*  >1.1.  1  .  .1 

k  .  o'.  ,  .  '■  .  ••  •  ■ 


ll  ‘t  r  t  ; 

l.'to  i  I!  k  id. 

t  0  1  O  1  1;  !  A  ]  ,  k.i.i 

1  t .  i  hr  .  »  1  .  ' 

t  .  . 

r  1  s  J  a  1  r  , 

....  ) 

M  !  r  ;  ••  .:ui  1  s 

1  1:  Ire!  , 

i  ! 

9.  * 

.  *  1* 

k.tJio  ; 

1  £11.1  I  S  .llu!  I 

1  iri  so:  o!  ; 

.1 . 0  -in..  1  1  1 

!  of.  • 1 1 

1  ! 

.  fj>  1 1  ; 

1  n  t  ho  (  .  “1 

”  .  k.ir-.£«  III! 

.  I  •  «  .  \ 

*  )  \t  . 

itn  ,  .  . :  i  v .» t  .  I  *  r  o.iyk  \c ;  .it  '  ►  ' 

c  .  .  .  : .  i  :  : .  ;  *  « 


( ’Y>  t  o  n  t ;  1 1  k  o  t  .in .  o  *  I  •  • 

*«o.  >, 

MuJJ  Jr  t  of ■  .  .  . 

to  ^  t  it  ; «.  t  i  i  .i  I  .inr..t  i  .  .it  i  .  !  1  .  h  i;  t  «■  r  * 

r.u!i .  i  r  i".  .  I  ,*c.' . 

>  i  o',  s*  i  v 

:  ( P  r  .  n  •  t  <•  n  •  ;  ;  ki  «.  .  -  •  .i:  .  <  t  I  r  t  <•  r  <■  ;  r  •  « 

I  i.J :  r. g  J  ,  k  .  ! .  >:  «•  i  hr  i  »,  \  .  ; 

'.or  >r. i  r, ,  ’«  *  . 

1  n  t  c  r  5  r  t  v  ru  e  i 
'.o.  : 0  . 

I'.ivcnport  ,  .  .  i  .m.i  I  R  v‘  , 

[Intro'Sw.t;  n  t  Thoorv  ; 

I  1 1 c ;  it ■;  tv  Irc^s.  !  >(  l 


k.ir>.!or 


i)  T  \  i 


.1 


t  Jr: 

O' 


1  ■  <•  - 

i  .1  r  tr  < 


,  .1  i  1 1  r  t  .1 
:  c  r «.  ’  .  iir* 


>  o  r  rh  1  k  .  \  .  1 .  ,  •  •  *  r » . .  ;  r  .  •  .  •  .  -  ;*  .  ;  • .  r 

/r;**.  [k'r\cr.il  J'roh  Jett*  in  soJir.g  s  n  '» onun  1 1  o  m  <  han 

»«ith  fccJb.icJ],  Thesr*  !  Report  .it  the  first  \v-p-o  *  .  .in  on  the 
Redundano  in  I  r.J  or  .it  i  .  n  ‘'iitrn,  l?t». 


f  hvorostenf  o ,  .  i' 

(St.iti 
”‘*vya:""  iic^i, 


1 1  c  .1 
190*' 


4  *  »  * 


Theory  of  of 


i  urctr 


transmitted  signals  bv  means  ot'  analysis  ot  the  received  specimens;  and  this 
in  reuses  reliability  in  diversity  reception. 


We  will  repaid  the  noise  active  in  the  d.tferent  branches  mutually  inde¬ 
pendent.  Ihis  is  of  course  true  it  the  noise  i s  internal  to  the  receiver  and 
1  r.  ttsost  cases  it  is  also  true  for  the  noise  which  enters  the  receiving  unit  from 
without 

I  he  transmission  factors  .  and  phase  shifts  differ  in  the  various 
t  ranches  in  a  channel  with  general  fading.  Diversity  reception  provides  the 
greatest  1101  se- resi  stance  pain  when  the  transmission  (actors  in  the  different 
brandies  arc  mutual  1>  unccr  re  1  at  e  1 ,  hut,  as  will  he  shown  below,  a  substantial 
cai  n  r.av  be  realized  even  with  a  certain  correlation  among  the  transmission  co¬ 
efficients  he  will  me  istire  tins  «.  o  rre  1  at  i  op  be  the  magnitude  of  the  correlation 

i  id  i  etwee:  the  sophasul  (  .)  ami  uuad r.'it u re  (  )  portions  of  the  fluetuu- 

c  I  s' 

ting  component  ot  the  transmission  factor,  like  the  definition  of  R(')  in  ex¬ 
pression  I  s .  (> )  ,  but  with  the  difference  that  here  we  are  const  Jo  imp  the  ta  tor 
1  ~iitu.il  sorrelat ion  between  twi  fading  processes  at  identical  moments  m  time' 
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h,  -  The  ifi'itlor.  for  this  is  that  with  x-.a  1  1  values  of  R  f.ippro  *  l  mat  r  1  v 

•  h  -  C . >  calculation  ot  mutual  e.  'rrcl.it  ton  i  nt  reduces  onls  a  “all  correction 
t  h  -ii,  be  illustrated  e .  e  *  a  1  narplrs  I  ,  and  also  that  when  i  s\sjr  of 

■Si  \  er  x  t  : .  reception  in  i  channel  wit!  fading  n  bei  ng  resigned  the  x~.»l  lest 

ss,*  le  values  a!  R  are  trss»*n  after. 

It  is  apparent  ‘hat  the  creates*  reliability  in  diverxitv  reception  ~a»  be 
•  nr.ed  when  the  a  ;  ri  ri  information  ibout  the  signals  expected  in  <•  \<.h  t  ranch 
is  til),  ifiii;e,i  In  xuf  f  i  c  lent  lx  ■  1  -w  fading  where  the  values  of  and  can 

!•  *  re.ii  c  te,l  in  all  the  receiving  branches  the  optmur  xnfrr  of  diverxitv  re.  rp 
t  i  an  is  that  of  coherent  surra!  i  on ,  The  optirsm  xyster  of  incoherent  surrafion 
-ill  be  deterr-ir.cd  for  fax?  fading  and  likewise  for  cases  where,  in  order  to 
simplify  i n<t  nirent at ; on ,  control  devises  utilizing  the  opportwn 1 1 i ex  of  pro 
dieting  and  are  !i xpenxed  with. 

In  addition,  we  will  <i urine  x extra!  simpler  non optimal  syx-e~x  of  di  - 
vrrsitx-  reception  which  a.e  crployed  in  jracttce.  including  the  xycte-  of  dis 
c  re  ’  e  su*r  at  i  on  . 


It  should  he  not c* 1 1  th.it  of  .ill  method.  i>t  diversity  nvcptii'  ot  l\  n 
ception  with  spaced  antennas  does  not  imolve  losses  either  of  siyn.il  powei 
or  nl"  the  system's  actual  carrying  capacity.  I»ei  leasing  the  rate  ot  1  r.  I  om.it  t  a\ 
transmission  (,e.^.,  in  time  diversity)  is  equivalent  to  .1  power  loss  because  it 
the  s.me  rate  it  would  he  possible  in  single  transmission  reception  to  im.  puisi 
the  dura’ ion  of  the  element  and  correspond!  iq;  ly  increase  the  average  i.itm  ot 
signal  e.ement  power  to  specil’ic  noise  power,  denoted  hi  h^. 


1  hi  s  power  less  must  he  tali'll  into  account  in  ordt  1  to  101r.ru  re  tin  in  1  e 
resistance  of  different  systems  of  diversified  reception.  lie  will  desi,;n.it'  h 
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6.2.  Coherent  Diversity  Reception 

let  us  t  i  ikI  t  lie  optimum  (in  the  sense  of  the  ideal  observer  criterion) 
decisi  n  )  riiKij  le  in  diversity  reception  of  .1  signal  element,  supposing  that  tor 
everv  receiving  branch  tin-  values  of  ..  and  are  exactly  known  on  t lie  Ice  1  s  ol 
analysis  of  the  preceding  elements  and  1 nt erf e re nee  is  independent. 

let  the  system  use  the  signals  ;  ft)  (r  ■  1...  .in'  and  let  the  i  th  branch 
receive  the  signal  (.'•  .2  1  |i  1  .....  tj )  : 
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where  h  is  ;”’.  arbitrary  constant. 

The  arriving  signal  in  the  i  - 1 h  branch 
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is  multiplied  by  the  sum  of  the  signals  of  the  local  oscillators  and  the  product 
(r>  V ’■;.  c)  goes  to  filter  1-  which  separates  the  component  with  a  frequency  of 
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Figure  6.2.  Variation  of  a  Diagram  for  Coherent 
Summation  for  Orthogonal  Signals  with  an  Active 
I n  terva 1  . 

1  he  frequency  -  is  so  select eu  that  it  is  lower  than  the  least  frequency 
of  the  spectrum  of  any  of  the  signals  z,(.t)  and  the  passband  of  the  filter  (1;.  ) 

so  that  its  ti-Hie  constant  t.  is  much  greater  than  the  duration  of  signal  element 
1  and  at  the  same  time  much  less  than  the  fading  correlation  time  Obviously 

K 

this  condition  can  be  met  if  fading  is  sufficiently  slow. 

It  is  easy  to  see  that  the  first  and  third  terms  in  the  braces  (b.SJ  have 
a  spectrum  beyond  the  limits  of  the  filter  passband.  The  spectrum  of  the  second 
filter,  generally  speaking,  occupies  a  passband  including  frequency  ..  how¬ 

ever,  it  can  be  shown  that  in  the  case  of  orthogonality  of'signals  z.(t)  the  value 
of  its  spectral  density  at  frequency  is  equal  to  zero.  Thus,  the  potential 

at  the  filter  output  is  determined  only  by  the  fourth  and  fifth  terms.  Obviously 
the  potential  at  the  filter  output  due  to  the  fourth  term  is  proportional  to 
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u,  to  1;  (()“•''(  ,,  j'  -  n  h 


Inasmuch  as  A “ (. t  )  =  1  / 2 P  and  in  an  active  interval  system  the  powers  of" 
all  signals  are  the  same  =  P  ,  tlien  this  jiotential 

Uf  ID  *  j(1/  *  °(1\  ((,,8aj 

does  not  depend  on  what  signal  was  transmitted  and  is  determined  entirely  by  the 


values  of 


(ij  .  (i)  . 

and  "  in  the  given  branch. 


The  potential  created  by  the  fifth  term  amounts  to  noise  from  which  the 
filter  separates  that  part  lying  m  its  passband.  Mien  the  filter  has  a 
sufficiently  narrow  band  this  potential  can  be  neglected  in  the  first  approx i- 
mat i on . 

Indeed,  it  can  be  shown  that  its  power  is  less  than  the  average  power  of 
*>  ') 
potential  (6.8a)  by  h~  :  (./T  times.  Inasmuch  as  the  magnitude  of  h“  with  any 

satisfactory  reception  whatever  is  much,  greater  than  unity  and  the  ratio  ■  ./T 

in  the  case  of  slow  fading  is  usually  not  loss  than  100,  then  the  addition  of 
the  noise  term  to  (6.8a)  causes  a  charge  in  its  amplitude  by  only  a  few  per¬ 
centage  points  and  in  its  phase  by  not  .lore  titan  5°.  A  consideration  of  this 
show,  that  in  the  diagram  of  figure  b . 2  coherent  summation  is  ac-omplished  not 
quite  accurately  but  the  off 'ct  of  this  inaccuracy  on  the  probability  of  error 
is  negligible. 

And  so,  we  will  assume  that  the  potential  at  filter  output  is  proportional 
to  (6.Saj.  This  potential  goes  to  the  second  multiplier  (frequence  converter) 
together  with  the  input  signal.  At  its  output  the  potential  is  proportional  to 


(6. *b  I 


where  z n{. ,  tj  is  the  signal  being  received  which  is  shifted  in  frequency  by 


and  in  phase  by 


.  The  first  term  in  (6.8b)  usually  can  °asilv  be  cut 


off  bv  a  filter  since  its  spectrum  lies  2..  higher  than  the  spectrum  of  the 

second  term.  The  second  term  with  an  accuracy  to  the  shift  in  frequency  co¬ 
incides  with  tlu  expression  figuring  in  decision  principle  (b.~).  In  other  words, 
at  the  output  of  the  multipliers  the  initial  phases  of  the  signals  do  not  depend 
on  the  number  of  a  branch  and  coincide  with  the  phases  of  the  local  signals  n.(t'). 

This  permits  performing  coherent  summation  and  then  using  local  signals  as  re¬ 
ferences  for  coherent  recep‘ien. 

We  will  now  proceed  to  computation  of  probability  of  error  for  several 
cases  of  coherent  diversity  reception. 

The  conditional  probability  of  incorrect  reception  of  a  signal  element  in 
coherent  summation  is  defined  for  given  values  of  and  ;('1  as  the  probability 


of  non-fulfillment  of  inequality  (6.7)  during  transmission  of  symbol  y.. 

Total  error  probability  is  found  by  averaging  the  conditional  probability  with 

respect  to  a  ^  and  0  ^  in  conformity  with  the  nature  of  the  fading.  Computa¬ 
tion  of  this  probability  in  the  general  form  is  laborious,  l.et  us  limit  ourselves 
to  several  particular  cases  which  will  permit  us  to  judge  the  order  of  increase 
in  noise-resistance  gain  in  diversity  reception  by  the  method  of  coherent  summa¬ 
tion. 

We  will  consider  an  act i ve- i nterval  binary  system  for  which  the  principle 
of  expression  (6.7)  for  receiving  symbol  v  may  be  written  as: 


\y»  f'\(  '>  (t)dt-  0 


16 . 9  ) 


If  symbol  v  has,  in  fact,  been  transmitted,  then- 

(  6 ’ • ' .  I)  jc".-,  (i)  -j  //•  •  >  (o. 


(6. 10) 


where  n.(t)  is  the  noise  active  in  the  i - 1 h  branch. 

Substituting  expression  (6.10)  in  (6.9)  we  derive  the  fact  that  the  condi¬ 
tional  error  probability  with  given  values  of  ^ 1  ^  and  in  transmission  of  symbol 
y  amounts  to  the  probability  of  fulfilling  inequality 
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Taking  into  account  that 
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we  may  writ  c  exp  res  s  i  on  ( t> .  1  1 )  a  s 


V  w  (t 
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Here  i's  determined  by  expression  (3.61a).  \w  will  point  out  that  with  orthogonal 
signals  >  =  1  and  with  opposed  signals  ,  =  >J.  The  integrals  on  the  left  side  >f 

’l-xprcssion  (6.10)  follows  from  the  fact  that  the  phase  shift  of  •  ^ 1  in  the 
signal  being  received  z ! ( t )  compensates  for  the  phase  shift  in  the  channel. 


this  i  uequa  lit)  U'p  reisi-tn  i  rHir'prfidcfs  J  nurc.ill.  diwt  r i Luted  raiuJuir.  \aii.iM< 
with  .s  itm  t  h  can  t  V  ca  i  expect  at  >4»0  of  zrr(  >  Ihrm  Jump,  ten  tun  ’hf  lucimidl 
way  si.nitlaii  to  that  t-wp  loycJ  sin  (haptic  III  and  i  v  (t”s)  Ihirrtcrc 

pi.-' r-s  i or  iif'  the  sun  *  r t  %  ton  on  t  hr  Lett  s.  i  d,e  i  t'  ■{ c» .  t  ] .« >  equals 


? 


s  i  .1 
t  he 


*, 


I  Ilf  iipht  side  o.‘  this  t  mqiu  1  i 1 1  wtrli  !  t,  iiil  laltia  « 
the  '('ro'b.i'i' 1  .  r  \  ..jf  i  u !  t  i  n  iiy  Shis  ,i  nil"  qua  J 1 1 1  ,  u  „  e  ,  , 
of  '.'iTor  h 


ll  fi  | 

J  is  .»  ]  •*  iii  f  1.  i  <•  J  .  I  *crn  r 

Slur  s  DtViJl  t  1 1  - 1 . a  I  i •  rot' .if  t  lit) 


I  hr  i  tirTij'  I  ot  r  i’ roh.it' i  3  j  T  v  of  cm 
biri.tr>  .Itanncj  in  cohere  n't  reception 
(t'.l.'i  with  lopect  f  all  a  1  ucs  t 


r  itaK.nj;  into  ,u  laiint  the  cermet  rs  of  a 
ll  be  vlernel  t"  a\  e r.i>; i  nr  i  * ;  1 1  s s  i  <  i 


lit  as  'ail'  .1  i  ool  at  •- 1  (  i  a  1  |  I  It  1  I  ll  1  a !  as  CIS 


a  1 

l\r  s 

hall 

>up; 

*S  i 

tli.it  the  . 

.i  1  Ur 

s 

■  vT  i 

random. 

hut 

ilo 

m 

vll 

an  ci' 

t  ll  T  O 

ho..  T 

t  he 

IX  t  t 

pt) . 

'll  1  i 

U!» 

;  .  e . 

t  he  re 

1  s 

pra 

1  f 

;  v  a 

1  ) X 

P.r 

1 

1  ad 

1 1'c  . 

and 

i  h 

at  : 

hi  t  r 

./risr. 

1  >  ^ 

lot  Inter 

4  U) 

the  dm 

f  e  refit 

b 

r.iiic 

he 

s  a 

I  SI 

h!j 

f  1 

ter 

Iii  ri 

t  lie 

nui 

pill : 

Udo  's 

b 

,  1 

[■L. 

•  1  '  1  I'S  . 

'.n;  s 

1  he  rati 

i  ol  t 

he 

"  i  >: 

n  a 

i  i' 

r*  v  r 

r 

: 

Th 

i  i  t  !  >, 

•  ran 

i. 

c.  ,  t 

to 

t  lie 

pV  k  t 

r  i  \ 

lei  se  del' 

>  *  \  . 

!  lie  .  urrplcle 

c 

rror 

r 

rob 

ah  i  i 

1  T 

\ 

i  n 

the 

ah  s>' 

r.j 

I-  t 

t  id  1 

n>:  a 

b  M  ' 

■  •  with  t  hi 

iH'l 

,J  i  t  i  on.i  i 

prob.i 

h  i 

lltv 

0 

f  e 

\yrc 

i  on 

1 0 .  i : 

"(’  I 

where  h]  S  *•  *»  •  ;s  •  In  resultant  ratio  of  signal  pewer  To  spectral  noi  n  density 
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after  coherent  surma  t  i  or.  with  the  optimum  weight  factors. 


Hus  result  ray  to  briefly  formulated  as  follows  optimum  cchrrent  summation 
results  in  a  signal  t  r  use  ratio  which  equals  the  sum,  of  the  sipnal-to-noi.se 
ratios  in  each  branch'  We  will  note  that  expression  (ti.l-ll  n.t\  be  easily 

■  Independence  follows  from  our  examination  here  of  mutually  uncorrelated  noise 
i”  the  different  branches.  fScc  note  1  to  Chapter  \ 1 1 . 
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Principle  was  obtained  with  thr  i'Mr|!  in  tl  p  rev  .  on*  1  >•  uni  noun 

( i  1  1  .  ' 

\  1  uc  *-  of  and  !•  i  -  i  It  iRvthcr  n  .v  t  u  r.i  1  ’ti.it  with  ,i  p  rev  i  mis  1 w  kn.”»t: 

u);nt  iJi  it  r  tbut  i  o:i  v> :  th.es  i.iluv'  ,t  -raid  In  |wmMv  without  particular 
d  i  t  i  i  sii  I y  by  a\  e  ray 1  ny  to  attain  the  kOnJjtioTi.il  pryb.il'  i  1 1  tv  of  <  i »:  n .  1 1  *'  r» 
a1  n  dl ,  to  riM  lire  .i  ilf.mrn  principle  optir.il  i  n  this  case,  .inJ  therein  to 
somewhat  improve  the  n-s  i  «  t  ancc  To  intot feren^r  in  rocep’ion.  However,  such  i 
Jctcmin.it  i  on  of  the  op  t  i  rv  >  1  decision  system  .m  t  .i  r  as  pi.ictio.il  value  i  <  con 
serned  does  not  yo  bevond  the  framework  o{‘  nathrri.it  i  c.i  1  s  qn.i’  i  on'  In  fact,  it 

coherent  reception  is  i  rpo*-  s  i  b  1  e  .  i.e..  .  1  .inJ  .  1  o.mnot  be  predicted,  then 

i.  S 

it  is  also  impossible  in  practice  to  preJiot  the  values  of  K  and  we  * an  not  '{.ilk 

'  '  i  i 

seriously  of  usiny  these  values  ir  optimal  processing. 

HaseJ  on  vhat  has  been  s.uJ,  how  the  cm  sterne  o)  correlation  between 
tr.msmssicn  coefficients  i ",  different  branches  of  Jiversity  reception  affect' 

’he  probahilitv  of  error  in  an  incoherent  decision  svsten  designed  in  aocor 
J  .in  s  t  w  t  h  ( 0 .  Q  3 )  M  is  of  practical  importance. 
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Wo  will  solve  (his  problem  for  tin-  case  of  greatest  practical  interest 
when  there  1  s  duplex  reception  ot'  binary  signals  orthogonal  in  the  intensified 
sense  m  an  act  i  ve  - 1  nterva  1  system.  I  he  probability  ut  error  i  "i  this  case  is 
Ji.iructen  _ed  by  a  general  formula  (b.3T>)  for  <>  =  J.  We  will  1  i  nd  the  eigen¬ 
values  he  solving  u>.3J)  which  for  the  case  under  consideration  can  he  put 

ii'  ' 

in  the  form 

I  ;  A  >  K  h 

*  v  1  n 

A“  h  |i/,'  ; 

•  i  *  i 


whole  R  H 
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Solving  this  we  find 


1  i  A’d  i  R.) 

1  '  ''  I'  A’,  i 


lb .  30 ) 


substituting  '('.aiM  m  (,<>.33i  after  transformation  we  obtain 
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li  the  case  t‘  uiuorre  1  at  ed  transmission  coefficients  when  ’ 
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which  vOincides  with  t hi  previously  obtained  formula  (0.37). 


use 


If  K  ,  =  1,  then 

i  i 

p 

1  T  If 

kr  sr.all  probabilities  of  error  when  h'll 
instead  of  (b.401  the  approximate  expression 


(O.JDbJ 

It  '  •  1  ,  it  is  pc'ss i b le  to 

lb. 40c) 


!  i  gu're  b.“  ske-s  the  dependence  of  probat  i  lity  ot’  error  in  the  *se  of 

diltereiit  values  of  k"  -Vs  indicated  above,  the  total  coefficient  of  mutual 

corn  laticn  of  the  fluctuating  part  of  the  transmission  coefficients  is  R^.  =  R“ . 

As  can  be  seen  from  the  figure,  when  R4.  ■  P.b,  the  existence  of  correlation  has 

almost  no  effect  on  the  effectiveness  of  duplex  diversity  reception,  i  veil  when 
Kj-  -  U.s  duplex  reception  provides  for  a  power  gain  on  the  order  of  it)  db  in 

comparison  with  single-transmission  reception  and  only  when  R.  (J .  8  is  the 

effectiveness  ot  duplex  re  option  significantly  reduced. 
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Thus,  the  existence  of'  correlation  has  a  noticeable  effect  on  duplex  re¬ 
ception  only  when  if  greater  than  0.7-0.S.  Therefore,  for  an  approximate 

evaluation  of  the  probability  of  error  in  the  case  of  diversity  reception  it  is 
possible  to  ignore  the  correlation  between  transmission  coefficients  in  different 
branches  if  the  coefficient  of  correlation  is  not  very  great. 

In  actual  diversity  reception  systems  the  magnitudes  of  R  usually  do  not 

exceed  O.o  although  they  very  rarely  are  less  than  0.2  [lj.  The  results  ob¬ 
tained  shew  that  further  decrease  in  the  coefficient  of  correlation  by  greatly 
increasing  the  spatial  diversity  of  the  antennas  or  partial  separation  does  not 
yield  a  significant  gain. 


Figure  6.7.  Probability  of  Error  in  the  Case  of 
Duplex  Reception  of  Binary  Orthogonal  Signals  with 
Account  Taken  of  the  Fading  Correlation. 

6. A.  ’lonoptinal  Methods  of  Diversity  Reception 

Radio  common i cat i ons  practice  with  diversity  rocejion  most  often  uses  in¬ 
coherent  decision  systems  whirl  differ  from  optimum.  There  are  many  variants  of 
these  systems.  Knowing  the  probability  distribution  of  the  transmission  co¬ 
efficients  wt  can  in  principle  compute  the  et ror  probability  for  any  system  and 
compare  it  with  the  optimum  system.  Here  we  will  limit  ourselves  to  a  few 
examples  which  have  to  do  with  act i ve- i nt erva 1  systems  orthogonal  in  the  inten¬ 
sified  sense,  hi'  will  consider  the  fading  in  the  different  receiving  branches 
t.o  be  uncorrelated. 


Maximum  Likelihood  Selection  System 

\s  applicable  to  binary  systems  this  system  (figure  0 . 5 J  is  based  on  the 
fact  that  each  element  is  received  in  a  branch  for  which  the  difference 

-  vS‘}“  is  max  i  rum .  Ibis  difference  is  proportional  to  the  logarithm 
of  the  likelihood  ratio,  from  which  the  svstem  also  gets  its  name. 

It  has  already  been  pointed  rut  that  in  duplex  reception  this  syster  is 
completely  equivalent  to  that  of  quadratic  addition  and  is  therefore  optimum. 
Mhui  <}  2  this  system  differs  from  the  optimum. 


We  will  use  the  notation 


to  calculate  the  probability  of  error.  It  is  easy  to  show  that  in  the  transmis¬ 
sion  of  svmbol  v.  the  random  variables  u.  have  the  same  probability  density: 

•  1  i 


tf-(a)  ■ 


•-V'v  -  -* 


-V'y  *1 


when  n<^() 


win.  II  11  () 


(0.  Wl 


An  error  in  signal  element  reception  occurs  in  one  of  Q  incompatible  events 
which  are  that  the  value  of  u.  in  the  i-th  branch  is  negative  and  exceeds  in 

absolute  value  the  magnitude  of  u  in  the  other  (Q  -  1J  branches.  The  probability 
of  such  an  event  is  „  ,,  , 


j- 


(nfiiu  tin, 


Consequently  the  pro.  ability  of  error  is 


n 

P  Q  j"  «■(«,) 

•  »  «, 


from  considerations  of  svnunetrv  it  i obvious  that  error  probability  will 
also  be  the  same  during  transmission  of  symbol  y ,, .  Substituting  expression 

(0.41)  here  and  changing  the  notation  of  the  variables  we  find 


(0.42) 


hr  F  ■  I"  ;,'v' 


ilti  I  tlx  - 
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This  integral  is  easily  computed  for  any  value  of  Q.  Its  expression  is 
not  quoted  in  the  general  form  because  of  its  awkwardness.  When  Q  =  2  the  error 
probability  agrees  with  expression  (0.37),  which  corroborates  th-'  optimality 
of  the  selection  network  for  duplex  reception  in  a  binary  system.  It  follows 
for  Q  =  3  from  expression  (0.42)  that 

2.vi|  ,  r.  |  an 

p  T>:rwT^x  ■.  :o 

1 o  compare  this  system  with  the  optimum  one  in  triplex  reception  we  will 
calculate  p  for  Q  =  3  from  expression  (0.30): 


p  v  (_*+'  V 

("i  1  -i’  L  *  f  . 


t'  ..'.;  i  ir. 


When  h 3  1  m  the  optimum  -.\sten  ,!  ia<! rat  i  >.  addition  p  *  lO'b.^  v'nlt 

i  1  i 1 

tor  t  he  maximum  1  i  ke  1  ihood  vlrpn-n  s\-.ter.  ;  "  I  !  .  r>  h  ,  .  Power  I  i  r.  !  It 

selection  system.  .is  comnared  to  tin  opt  ir.ura  m  xt  on  i  s  0.J  d!  .  i  la  r»  ■  t  *  t<  .  t 
triplex  reception  the  maximum  1  i  ke  1  i  hoc.!  selection  sv-tin  i  ■.  M.ircrli  i  *•  t  *  •  t  i « > : 
to  the  optimum. 


Figure  6.8,  Maximum  Power  Selection  System, 

Maximum  P.n-.er  Selection  System 

1  >n  of  the  most  k  i  dcs  p  i  eiui  s\-te;;s  *f  ill  vers  1 1  y  reception  i>  the  u  r  i  "i. 
svst-T  u  th  respiv  t  to  maxi  nun:  power  I  figure  o .  m  .  Here  each  branch  has  its 
own  :ec • >i on  system  ithe  same  a;  m  s i ng 1 e - t ransm ss i on  reception',  hut  the 
final  sle  i  ion  is  ile  t  e  rn  ini  .1  from  the  branch  in  which  the  power  f  the  iT.-riuii 
signal  .  greater  than  in  the  others.  Ihere  are  many  v.nieties  of  these  sxstems 
which  differ  in  the  method  of  comparing  signal  powers  in  the  branches  and  in  the 
net  he  si  :  swi  t  J;  i  nr  the  branches  .  >\e  will  r.ot  pause  over  these.  Ill  c  basis 
aider  I  >■  i  lift  idea  of  these  systems  is  that  during  failing  the  most  re.  i  able  lc 
,'ision  can  be  made  in  the  branch  in  win  eh  transmission  coefficient  assumes  1  ts 
greatest  \  a  hr  a  given  moment.  it  is,  however,  impossible  to  get  a  direct 
me  as  1 1  !'■  Tien  t  ,t  transmission  coefficient  because  of  noise.  Therefore  this 

measu  r  •  ••  out  i  replaced  by  that  of  the  power  of  the  .neoming  signals  In:  conuinc- 

t  i  Oil  w  i  '  1.  n oi  so  . 

lo  estimate  the  noise  resistance  of  such  a  circuit  we  will  calculate  the 
error  probabiiiti  in  duplex  reception  of  binary  signals. 

■>  i 

l\e  will  i  'mate  the  power  of  the  incoming  signal  from  the  sum  of  Vj  +  V  ~  . 
If  symbol  y  was  transmitted,  then  an  error  may  occur  as  a  result  of  one  of  two 
incompatible  events: 
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t  ho  subscript.'  and  1 1‘ r;  f-'j'i  ii'l  to  ti.”  presence  or  il  -er.  cc  ot  tlu*  appro 

r  n  1 1 o  si  pn.a  1  i  ,  whence 
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Substituting  here  the  v :t ] u* *  k  r  j  4  •  j  ,  we  find 
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That  we  may  find  the  probability  written  in  the  right  side  of  expression 
f  <j .  4  s )  expression  C  •  -1  o> ;  must  be  averaged  with  respect  to  all  the  values  ot 
•’  and  -  j  which  satisfy  condition  j  ■  •  j.  By  doubling  this  probability  wc  I  i  ml 

error  p  rob  ah  i  1  i  t 
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ligure  (  . (viir\r  represents  this  re  1  at i onsh i p .  (ompuri  up  it  to  curve 
1  p  lit  t  i’il  from  forr.uli  It).  tor  quadtatli  addlt.oll  we  tnai  sat|s)\  i.iim'Iu". 
that  t  In*  difference  I  i  tutTii  t  In- in  is  not  wry  s  1  gn  1 1 1  rant . 

It  h*  1,  tlu  in  ijU.nlrativ  addition  p  a  h,,  win  In  in  tM.tin.iin  puun 

<i*  lee  1 1  on  p  la  ali*.  i.e.,  the  power  gain  in  the  maxi  nun  pourr  si- Kot  i  on  net¬ 

work  las  compared  ti  the  optimum  system  ot'  incoherent  addition!  is  no  more  than 
U.s  ilb . 

General  Comparison  System 

In  a  general  comparison  net uork  (ligure  o . 10)  incoherent  i  iversitv  reception 

is  accomplished  as  follows.  Values  of  vj1'  are  t ormed  in  each  branch  bv  uuad 

rature  reception  or  with  matched  filters.  All  of  these  tallies  are  compared  to 
each  other  in  a  single  comparator  an  I  the  decision  is  made  in  ac«.ord  with  the 

subscript  of  the  maximum  value  of  V '  1  1  . 

r 

let  us,  as  in  the  preceding  case',  pass  from  the  values  ot'  V  j  1 '  to  those 

t'"  .  *’  p  I.  ,m.i  1.  . Q 1  whose  probabilities  densities  are  expressed  by 

formula  lt).44j. 

Correct  reception  during  transmission  of  some  symbol  y  occurs  when  one  of 

the  Q  incompatible  and  equiprobable  events  which  consist  in  some  value  of 

(i  =  1  , .  .  .  ,  Q  J  exceeding  each  of  'he  other  (mfj  -  1)  values  of  also 

occurs. 

The  probability  of  correct  reception  therefore  is 
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Ibis  error  probability  is,  of  course,  greater  than  in  the  ease  of  the  op- 
r i irum  system  of  quadratic  addition  (0.3S),  but  computations  show  that  the  dif¬ 
ference  between  these  probabilities  is  very  insignificant. 
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Figure  6,9-  Probability  of  Error  in  Orthogonal 
Binary  Systems  for  Different  Duplex  Reception 
Networks:  1,  Quadratic  addition;  2,  Maximum  power 
selection;  3(  General  comparison. 

In  the  particular  case  of  duplex  reception  in  a  comparison  network  we  will, 
by  substituting  Q  -  2  in  expression  (.6.47),  derive 
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Impression*.  for  the  p  robabi  1 1  t »  ot  error  m  the  ..iso  o!  «.  orre  i  at  i  on  tadiop 
ami  '}  m  oht  unr.l  m  (t'.  9.  1!.  la.  1 '• }  and  in  r.inv  otho*  v>or»  v  in  jilj 

:'n  re*  •> ) s  1  ar.co  to  i  nt  e  r  t'orem  e  in  the  onr  <>*,  diiersitv  reception  ot  nonortho 
peri.i!  s  !  |C  .s  i  <*  i  •>  i|io  uctcmr.i-i!. 

Vtirnti.n  should  hr  drawn  to  Vhe  !  .u  ?  th.it  the-  «:o«*t  t  i  v  lent  ot'  r.utu;»l  cor 
re  1  at  t  or.  of  two  Has  le  x  ph  \  a  lues  <  oik?  a*,  the  ou’l'l  mrnt  ot  autocorrelation  of 
a  P.  I.  c  )  p-h  pro.  i  i  «  a  nor  nep.it  tie  vaiu-  ,  i  he  re  f  ■.  rr  ,  diversity  reception 
in  the  i  nr  of  H  .«  v  !*  i  ph  f.islirip  n  r.oil  ettoitive  when  the  (adinp  in  T(ie  I  -ranches 
i  s  rntu.el  h  urn  r  rre  1  at  e.i  .  In  the  <ener.il  .as(  whs  n  the  fadinp  i  s  not  h.tvieiph 
•t  ncp.it  i\c  fa.lt  np  ,  •  rre'lat  i  on  i  ■>  pn'iMf .  <  *5- v  i  ex.  s  1  v  ,  Ji.e-isif-..  ret  option  in 
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It  ,  howtver,  t h c  values  of  h  are  unknown,  then  the  quadrature  addition 

systems  remains  iptimal  1 1  r.  the  sense  of  the  generalized  criterion  of  maximal 
likelihood).  lhe  probability  of  error  in  this  case  is  [12J 
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q'ec i 1 i cai ly ,  for  duplex  reception  from  this  formula  we  have 
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In  the  deiivation  of  these  formulas  it  was  assumed  that  the  spectral 
noise  density  in  all  branches  is  the  same  and  the  power  of  the  signals  differs. 


\  comji.ir  i  son  of  I(>.t2.i  and  shows  that  when  h.  ••  1  and  I, ,  •  1 

'■oth  these  formulas  coincide  asyropt  ot  ;  c.i  1  ly  : 
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sometimes  use  is  made  of  the  method  of  diversity  reception  with  coherent 
tddition  of  signals  and  subseuucn’  incoherent  rectification  [19].  With  respect 
to  resistance  to  interference  it  occupies  an  intermediate  position  between  op¬ 
timal  coherent  diversity  reception  and  quadrature  addition.  The  probability  of 
error  in  the  general  case  when  the  averaee  values  of  the  ratio  between  signal 

power  and  spectral  noise  densitv  h“  in  the  different  branches  is  not  the  same 

'  d 

as  shown  in  I  I  d  I  ,  is 

n?  I 
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n  I-  I  V  (b.toj 

i  i 

\s  alreadv  indicated,  the  probability  of  error  in  actual  diversity  recep¬ 
tion  systems  is  greater  than  a  theoretical  system  mainly  due  to  the  dissimilar 
amt  1  i  fic.it  ion  factors  in  the  diversity  branches.  In  the  ease  of  Rayleigh  fading 
are!  duplex  reception  using  a  quadrature  addition  system  and  also  a  maximal 
power  selection  system  the  dependence  of  the  probability  of  error  on  the  asym¬ 
metry  of  amp  Illicit] on  factors  is  computed  in  [12].  It  is  interesting  to  note 
t at  th*  quadrature  add.  turn  -.vs  ter  is  much  less  sensitive  to  asymmetry  than  the 
maximal  power  selection  system. 


.  i.’arry  mg  ap.n  >t  i  I'h.iimH  with  sp.iced  reception.  I'  •■p.KTii 

reception  allows  larger  ui.mtitir  >f  inl'i'rn.it  umi  t  <  'e  ilciivnl  from  tin- 
signal  th.H  1  ml  i  \  i  ilu.i  1  reception.  I  he  refor*  it  i'  pos-.  i  >»  1 1-  to  •- .n  thit  t  he 
increased  carrying  capacitx  <>l  tin*  Punnc!  o  due  to  the  tit  i  I  .  rat  t  on  of 
spaced  reception. 


In  case  it  optimum  coherent  .ill  1 1  t  on ,  it  i  s  possible  to  e  tim.iti  t  ?.«• 
carrvmg  capacity  on  the  ’ » .i  ^  i  ^  ot  t‘«-  Upenn.m  theor-  [ |  .  which  i  ■  •>  ’hat 
the  resultant  ratio  ot'  t  hr  signal  power  t  *he  noise  power  :  *■  e.uii!  t  the 
cut;,  ot'  t!--  v  orrespond t t'g  ratios  tn  ill  're-  'os.  It  i !  :  '-j  m,  h-  •  ,  r,.  uieiiticii. 

t  hon 

a  .  <>  \ 

'  '  *  '  *  i.  ! 


it  y  (reception  on  t!ie  m  ace.l  antenna  the  ratio  mcr<a  e  '•  i  !.».*  -i 

ot'  Q .  It  should  *’e  mentioned  that  the  %.»”•■<•  rcoilt  could  ’-e  >ht  lined  us  -  g 
a  single  int  enna  whose  irea  is  ennui  *o  the  mi  r  •!  Th»-  areas  t  ill  spaced 


ant ennas 

.  I  f  fa 

ding  is  absent,  t 

‘•et. 

in  t '  •  cast-  s  ?  i  - 

p (>  b  J  •  *  « •  t  i 

i  t 

i  n.i  t  * 

spac i ng 

cap. ic  1 1  y 

bv  su*  st  1 1  uf  i  ng 

t'  - 

.,u.inf  .  •  x  if  for  1 

*  :r  v'h.i;MU)i 

V 

t  «r*i:  1 

1 1.  s.n  , 

with  P. 

V 

under*. !  ood  to  ‘  e 

•  * 

;  ’» >•  r  • !  t  he  s  i  gn. 

l  1  1  V.  i»fir  ** : 

It!  . 

t 

the  rise 

:  ■■  er. 

!K 

t lie  fading  Ha>leighs,  if 

f  he 

latter  is  r  l  g  111  l ' 

cart  el  .It  ed 

i 

all 

h  r.mchos 

.  It  n 

pos s i h 1 e  to  ! i nd 

.  i,,. 

s  i.  .  a"  ic  i  f '  ‘ 

•x  v.  ,i  x  ’!  s-p 

•  *»  ? 

:  *  it  in 

P  tor  QP  in  formula  .  v-  It.  *.  >*.e.er.  fading  is  not  correlate.!  in  the 

v  V* 

'’ranches,  then,  as  it  was  note!  :n  footnote  1.  apart  iron  the  structure  the 
power  has  in  ,i  reduced  spue  ird  dispersed  truant  •.  t  i  e  s  h  ,  and  w  i  t  h.  gr<-,it 

stgnifwin.e  the  )  conditions  >•  reception  appro  ich  a  .  nditio:  in  t'.i  ,  h  inn 


itlhout  fading  as  in  the  .irr>  ng  c  i  tacit' 


i  ;  s ; 


t  w  *  i  **  r  .1  t  '  j 


Hy  =1  t  rom  t.t>l  it  loll  -us  that  resulting  value  h  o  r  :  inctmised, 
and  !iy  I  it  dimni  'lies  with  the  itureas"  In  these  conditions  Mi”  spaced 

reception  permits  the  i  irrvmg  capacity  to  mcre.ise  onlx  to  ic  ount  t'«r  the 
decreased  dispersion  h  .  Ilu-n  with  a  conversion  on  the  -.ant  re  su  1  •  ;  op  power 
of  the  signal  the  spacing  capacitv  is  approa  tied  with  the  inert  r-e  ot  ..  :  r  ’tn 
rS.  85  to  J . 84 }  .  As  we  alreadx  covered,  the  maximum  Inference  between  values 
in  these  terns  cannot  exceed  I" 


In  (16)  the  author  computed  ihe  carrying  capac..v  i  the  case  ot  livers,  tv 
reception  in  the  absence  <»f  lading  lull  allotting  for  the  correlation  of  interference 
in  the  diversity  branches.  In  (  I "  |  the  author  determines  the  .  irr-  mg  cituci'i 
of  a  channel  formed  by  silecting  the  branch  with  the  maximum  transmission 
coefficient  in  the  case  of  kayleigh  fading.  Such  a  western  is  n«l  phvsic.il  |v 
realizable  since  the  existence  of  interference  foes  not  permit  measuring 
exactly  the  coefficients  of  transmission  tun  it  may  serve  approximate lv  as  ,i 
mathematical  model  of  a  system  for  selecting  based  on  maximum  power.  lor  the 
carrying  capacity  the  following  expression  i  obtaiueu: 


IlililliilllMife^MiiiiliaiMiliiidrxfifiijaUiiiiailMte 
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CHAPTER  VI  I 


CHANNELS  WITH  PARAMETERS  DEPENDING  ON  FREQUENCY  AND  WITH 
FAST  FAD  INC 

7.1.  General  Description  of  a  Linear  Communication  Channel 

The  preceding  chapters  have  discussed  the  conditions  for  t ransmi 1 t i ng 
signals  in  channels  whose  parameters  do  not  depend  on  frequency.  In  all  thece 
channels  noise  resistance,  as  we  have  seen,  dues  not  depend  on  the  line  struc¬ 
ture  of  the  signals,  in  particular  on  their  base  2 IT  and  other  spectral 
charact eri s t i cs  ,  but  is  determined  only  by  the  signal  power  and  the  pairwise 
"scalar  products"  of  the  signals.  for  c\amp!>  ,  for  all  act i ve- i nterva 1  systems 
orthogonal  in  the  intensified  sense  the  probabilities  of  error  are  identical 
if  the  code  base  and  signal  element  power  are  the  same.  In  particular,  the 
rate  of  information  transmission  in  those  charnels  may  be  made  arbitrarily 
great  at  a  given  error  probability  by  decreasing  the  element'  length  and  pro¬ 
portionally  increasing  signal  power  because  th  s  retains  the  ratio  of  signal 
element  power  to  spectral  noise  density. 

This  and  the  succeeding  chapters  will  study  channels  in  which  additive 
noise  or  distortion  depends  on  frequency.  I!.',  reception  conditions  in  such 
channels  depend  both  on  the  general  power  characteri st i cs  of  the  signal  and 
on  its  spectrum. 

\  channel  with  selective  lading  i ,  as  h.is  already  boon  noted  in  I'hapter  \ 
characteri zed  by  the  signal  coning  to  the  receiving  unit  nvr  several  paths 
with  travel  d i f ferent i a  1 s  of  t  common  urate  with  the  value  I  1  or  exceeding 

it,  where  I  is  the  nominal  signal  frequency  ''and.  If,  furthermore ,  the  values 
of  't.  are  commensurate  with  signal  eh  rent  length  I,  then  multipath  pn-pi 

gat  ion  causes  both  selective  fading  and  mpo.it  bn  i  !  adjacent  signal-,  on  each 

other  i.echoi  ng  . 

If  did,  the  base  of  the  system.  . s  n  more  thin  several  units,  the  values 

of  1  I  and  1  are  of  the  same  order.  ilurctore  i  r.  those  ugn  ib  the  values  el 

't  are  commensurate  with  !  I  *  >n  I  \  when  the.  i:v  lose  t .  I  md  the  nhenom  non 

i 

of  selective  fading  i  always  observed  t.g.the:  with  the  echo  -  phenemenu  n .  l\;u  n 
base  Jfd  is  large  cases  are  possii  where  t  is  i  or.rr.ensurate  with  1  I  ,  bu* 

i 

substantial!)  less  than  1.  In  these  ..is'-s  --elective  fading  occurs  without 
perceptible  imposition  ot  ad  i  acent  signal  elements. 

The  interference  of  the  components  of  the  incoming  beams  and  the  nr.posi 
tion  of  the  adjacent  signal  elements  hinder  reception.  <!n  the  other  hand, 
each  arriving  beam  carries  information  about  the  message  which  is  being  trail 
rnitted,  which,  generally  speaking,  should  mcp-ase  the  possibility  of  liable 
distinguishing  signals,  as  compared  with  the  conditions  in  a  single-path  channo 


Up  until  relatively  recently  selective  fading  and  echoing  were  regarded 
only  as  factors  impeding  communications  and  reducing  carrying  capacity  and 
reception  fidelity.  In  designing  communication  systems  for  multipath  channels 
every  effort  was  bent  toward  overcoming  the  effect  of  the  arriving  beams,  ex¬ 
cept  the  first  (or  the  most  powerful)  and  toward  approximating  reception 
conditions  in  a  "single-beam"  channel  (i.e.,  channel  with  general  fading). 

.Not  a  few  clever  ideas  were  proposed  for  this  purpose,  many  of  which  have  not 
lost  their  practical  value  even  today.  The  chief  ones  will  be  described 
lie  1  ow . 

Of  late  years  (beginning  about  1957)  the  approach  to  multibeam  channels 
has  drastically  changed.  Instead  of  combatting  the  multibeam  nature  of  the 
signal  efforts  are  made  to  utilize  to  some  degree  the  information  carried  by 
each  beam  and  to  secure  greater  Ti del i ty  (or  carrying  capacity)  in  multibeam 
than  in  the  single-beam  channel. 

It  should  not  be  thought  that  multibeam  propagation  is  found  only  in 
radio  channels.  Multiple  reflections,  although  less  clearly  expressed,  are 
also  found  in  wire  channels,  for  example,  as  a  consequence  of  nonuniform  cable 
Apparently  they  will  also  be  inevitable  in  future  waveguide  channels. 

Channel  Models 

Ihe  most  general  description  of  passage  of  a  signal  through  a  linear 
channel  is  provided  by  a  random  impulse  transfer  function1  lift,:)  which  ex¬ 
presses  the  value  of  reaction  at  a  channel  output  at  instant  t  if  at  instant 
t  -  •  a  single  impulse  (do  1 ta- funct i on )  is  delivered  to  the  channel  input 
1 1-  i  gure  7.1). 


Figure  7-1.  General  Diagram  of  a 
Channel  with  F requoncy- Dependen t 
Variable  Parameters. 

i )n  the  basis  of  physical  practicability  any  realization  of  a  transfei 
function  satisfies  the  condition 

t)  0  when  t  -n,  (".  1  ) 

since  the  reaction  at  the  output  cannot  occur  any  sooner  than  the  action  at  tlu 

These  are  other  forms  lor  expressing  a  channel  impulse  transfer  function 
[1-5|.  The  expression  used  here  is  the  most  convcnimt. 
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input.  If  a  signal  z(t]  arrives  at  a  channel  input,  the  signal  at  the  output 
(without  considering  additive  interference.)  is  equal  to 

l 

z'(<)--  -J  [//«/.  -.)•’(/--)</-.  (7.2J 

o 

Inasmuch  as  ll(t,ij  is  a  random  function,  then  z'(tj,  with  an  unchanging 
realization  of  z(t),  will  also  he  a  random  function,  even  in  the  absence  of 
additive  interference.  Therefore,  the  probability  of  error  in  such  a  channel 
with  a  reduction  in  interference  spectral  density,  generally  speaking,  does 
not  approach  zero. 


For  a.,  realization  of  1 1  ( t  -  : )  it  is  possible  with  an  unchanging  value 
of  t  to  define  the  instantaneous  transfer  function  as  a  Fourier  transform 
with  respect  to  .: 


>  (/■•>.  t) 


i 


//(/.  -.)r.\| il 


(7.  3  i 


Here  the  lower  limit  of  integration  is  zero  in  accordance  with  (7.1). 

We  will  note  that  Y(j*,tj  does  not  have  such  a  simple  physical  meaning 
as  the  transfer  function  Y(j  )  of  a  circuit  with  constant  parameters  which 
amounts  to  a  ratio  between  complex  amplitudes  constituting,  w;th  an  angulai 
frequency  of  -  at  the  output  and  input  circuits  in  a  steady  stite.  In  a 
system  with  variable  parameters  a  steady  state,  strictly  speaking,  generally 
does  not  occur.  Therefore,  it  cannot  he  considered  that  the  spectrum  of  a 
signal  at  the  output  of  the  channel  is  equai  S  ( i . )  Y  (i  .  ,  t  i  ,  where  S  ^  C  .i  -  ' 

s  the  spectrum  of  realization  if  signal  z  (ti  at  channel  input. 

'lev  (.  *  the  less  ,  Y(L,tJ  can  be  considered  as  a  complex  signal  at  the  channel 

output  when  an  analytic  monochromatic  signal  at  a  frequency  of  .  and  a  single 

amplitude  of  z(tj  =  exp(j.ti  is  delivered  to  the  input.  Indeed,  substituting 
this  value  of  z(tj  in  (~.2)  we  obtain 


Z'  (!)  j  II  (I,  -)i  X|>(|  «/  jut-)  ,/- 

(7.4) 

i-  exp  (/»0  ^  /((h  *)cxp(  /--.)</'  <’(•! )'  </-.  l) 

0 

For  an  actual  monochromatic  input  signal  z(t.)  =  cos  ( .  t  +  :J  this  means  that  the 
output  signal  is  equal  to 

z' (l)  -  cos  (<ul  -|  'it)  KV  Y  (/“>.  I)  )  ssn  («».’  ;  ?)hul  (/IU>  0  - 
--|  Y  (/«>,  l)|Cos  -f  f  —  y(f||. 

where 


Itn  )'(  <•»  0 

(H  aidg  ,(v  j  (  w  ,,  • 
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Here  .t  is  important  to  note  that  the  output  signal  v-.il!  not  he  monochromatic 
inasmuch  as  it  is  modulated  in  amplitude  and  phase. 

lor  the  purpose  ot'  obtaining  surveyahle  results,  we  will  have  to  limit 
somewhat  the  generality  of  our  observations  by  introducing  certain  conditions 
which  satisfy,  for  all  practical  purposes,  all  communication  channels  in 
actual  use.  first  of  all  we  will  consider  ll(t,..),  as  function  t  (with  a  fixed 
:),  a  stationary  process.  Then  Y(.iui,t)  (with  a  fixed  .)  is  also  a  stationary 
process  and  its  correlation  function  with  respect  to  t 

K,  I  /«.  M  1  (/■>.  I,  1  Pll".  t;\  •  (/*.  6) 

depends  (not  considering  ..  )  only  on  the  difference  t,  -  t  = 

The  fourier  transfonn  of  U  (j.,"j  with  respect  to  the  variable  •  is 


!’(/">.  ill)  1  Rt  i/u).  Oj,-Xp(.  .jiHtttr, 


(7.5) 


defines  the  spectral  power  density  of  fluctuations  in  the  transfer  function  for 
components  of  the  signal  at  frequency  i,  . 

We  will  further  assume  that  a  channel  has  a  limited  memory,  i  . e .  ,  that 
there  is  an  interval  of  time  I.  during  which  the  transfer  function  is  almost 
completely  damped,  or,  in  other  words,  for  any  value  of  t  when  i  _  I. 


//(/.  0/0- 


(7.6} 


We  will  expand  ll(t,*)  with  respect  to  the  variable  ;  into  a  fourier  series 
over  the  interval  0  •  :  •  I.: 


//('.  '•)  MO  -!  £  l:if*  (Oc-is 


1:11,-  ! 


where 


-|  (w*(/)MT.av.|.  0».t «»./.. 


f. 

MO  1  j// It. 
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Substituting  (7.7J  in  (7.2)  and  considering  the  limits  of  change  of 
we  obtain  the  following  expression  for  a  signal  at  a  channel  output: 
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r  ' '  I 
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passband ,  i  .  e .  ,  there  is  ria.'.ia  Hide  such  that  fur  am  t  and 
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ii|'  course,  ..and  1 1 1  ens  i  ~  .  1 0 )  and  (".9*  contradict  !,•  nether  iiM-anid;  a>  two 
I  i.n  turns  linked  by  a  Itnimer  t  rans  form  cannot  both  be  finite.  hi  rt  In-  mere  , 
e.\|>i  e.;s  i  or.  i~.iOJ  contradicts  tin1  condition  of  physical  i  ea  i  i  nab  i  1  1 1 expressed 
in  1  i. aret'ore ,  we  introduce  (."'.6;  and  l". 10  as  approximate  equalities, 

as  stilt! .  ng  tb.af  they  can  be  met  wit!:  any  des.reu  accuracy  if  sul'f  i  c  i  i  nt  ! large 
!  and  ,  are  selected.  The  latter  holds  for  all  .actual  channels  inasmuch  as 

they  have  losses  as  a  consequence  of  which  the  transfer  function  becomes  damped 
with  an  increase  m  •,  and  inertness,  ;i<  a  consequence  of  which,  w.th  suffi- 
cientlv  large  ,  the  modulus  of  the  transfer  function  'Wj.,ti  'uoits  as 
s  r:a  11  as  des  i  red  . 

tif  course,  the  channel  models  obtained  in  thi  way  will  a  1  s  >  h<  app  i\;ai- 
i  ate.  However,  they  c.an  be  made  preci  se  bv  a  limiting  transition,  assum  i  n,i, 

:  ha  t  i.  and  .  ,  app reach,  i  nf  i  n  1 1  y  . 

\nd  so,  assuming  that  condition  ( “ .  I U I  is  met,  it  is  possible  to  represent 
transfer  function  Hit,:  i  m  the  fen:;  of  ,  hutch. ikm  series  witli  respect  to 
variable  (see,  for  example,  [1]): 


r .  1 1 1 


there  ..  ( t  !  -  H(  t  ,1.  •  )  ;  and 
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If  condition  ‘".p!  is  also  met,  the  upp.er  limit  in  t  b 
■,;ua  1  to  I. 


•o.i. •,  nav  be 


I.  tcb.  term  ot  file  sen  to  represent  ;  a  random  function  of  tine  it  t 

Multiplied  'or  the  transfer  function  of  e:  idea!  j  phy  <  .  c,t  1  I  \  :;i  i  ea  1  .  cab  1  e  '  pi 
response  filter  of  lower  f  requeue  i  es  with  a  limiting  angular  frequency  of  ... 

shifted  in  time  bv  !>•  .  This  permits  formal  representation  ot  the  channel  cir- 

d 

cuit  in  the  form  of  a  delay  line  by  line  i.  wlu  !i  passes  f  i  eqtienc  i  os  ., 


with  taps  every  fb.e  volt.ag.es  taken  iron;  a  tup  are  multi;  1  :  ed  by 


■  and 


are  then  sumn.atcd  and  the  additive  interference  aided  iligur.  .  /  .  Thus,  a 
.l.annel  mode  i  is  obtained  in  accordance  with  which,  the  signal  p  •. -Ses  from  ilium 
in;  ut  te>  output  along  carious  paths  ("beams")  havin.r  di  fferent  t  i me -dependent 

ceetficients  of  t  ransmi  s-.  i  on  l\e  will  fill  such  a  mode!  i  pn  1 !  i  bear, 

propagation  model.  Its  advantage  in  compari  son  with  the  ger.eril  c  i  rcu  ,  t 
(figure  7.1.)  is  that  in  each  separate  beam  the  coefficient  of  transmission 


depends  onl)  on  time  and  not  on  t  requency .  I’ie  frequency  dependence  men 
only  in  the  result  ot  interference  incurred  in  summating  the  beams. 
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V  Kl  J 


Figure  7.3.  Model  of  Mu  1  t i beam  Propagation. 

Both  of  these  models  represent  the  same  channel  and  therefore  can  he,  with 
equal  riglt,  used  for  analysis.  Both  of  them  describe  the  processes  in  a 
channel  w  th  the  same  approximation  (increasing  with  an  increase  in  I.  and  .  ,j . 

In  some  cases  it  is  more  convenient  to  use  one  model  and  in  other  cases  the  othei 
and  this  is  determined  mainly  by  the  nature  of  the  signal  used.  .  In  deriving 
these  mix  els  we  base  ourselves  only  on  a  phenomenological  description  of  a 
channel  using  transfer  function  ll(t,:l  without  drawing  on  any  physical  ideas 
about  actual  processes  occurring  in  a  channel.  In  other  words,  the  channel 
is  considered  a  "black  box"  which  we  may,  with  equal  right,  consider  met  by  the 
diagram  in  figure  ~.2  or  Figure  ~..t. 

If  we  were  to  speak  of  the  physical  essence  of  the  passage  of  a  signal  in 
a  channel,  it  would  be  very  little  like  any  of  the  models  oltained. 

it  is  easy  to  see  that  in  meeting  conditions  i,7.6j  and  ."’.10J  each  of  the 
models  has  21.  (...,)/ 2~  -■  2(..  ,)/..j  branches.  With  an  improvement  in  the  approxi¬ 
mation  (by  increasing  the  calculated  values  of  I.  and  this  number  grows  and 

this  makes  analysis  difficult.  In  some  cases  it  is  possible- to  greatly  de¬ 
crease  the  number  of  branches.  One  of  these  cases  is  that  when  we  may  consider 
that  a  channel  passes  frequencies  only  within  limits  from 


where  ..  is  a  certain  average  frequency  divisible  by  '.si.  Obviously,  it  is 

ci  V 

possible  i  n  the  model  shown  in  Figure  7,2  (if  only  in  t  lie  fiist  approximation) 

to  exclude  branches  with  f r<-<iuenc i es  less  than  ...  -  '2  and  the  total  number 

a\ 

of  branches  proves  to  he  equal  t 


which  yields  a  great  reduction  if  jAfiy.O, 

Similarly,  it  is  possible  to  reduce  the  number  of  branches  in  the  model  of 
Figure  7.3.  For  this  purpose  we  represent  the  transter  function  by  its  enve¬ 
lope  and  the  instantaneous  phase  by  the  variable  :: 
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lie  re ,  II  is  the  cm  c  lope  if  thi-  transfer  function;  . 
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It  can  be  shown  that  I  i  ^  ( t  ,  •  j  and  II, (t,  )  are  linked  by  a  Hilbert  transform  ind 
their  spectrum  is  concentrated  in  a  hand  from  0  to  '  /J. 

We  will  represent  1 1  ^  ( t  ,  I  and  ll,(t,:l  m  the  form  of  a  lotelmkov  series 
and  obtain 
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represents  a  transfer  function  of  an  ideal  liand  filter  w:th  an  average  fre- 
ijuency  of  .  and  a  passband  of  '  shifted  by  interval  k,.  The  function  con¬ 
jugate  with  it  which  is  obtained  by  shifting  the  phases  of  all  spectral  com¬ 
ponents  through  90°  (the  Hilbert  transform)  will  be 
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In  light  of  the  possibility  of  rearranging  the  linear  elements  of  the  cir¬ 
cuit  we  obtain  the  channel  model  shown  in  figure  7.1.  In  this  model  the  nuaibe 
of  branches  (degrees  of  freedom)  is  also  equal  to 
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(  itiguty  II  channel'*  .lit  In  ilrc.ii  ous  t  1 1  ul !  j  .isnuiui  ihanrn  Is. 

\s  will  Ih  <nn  iron  uh.it  follows  tor  c onun icnc e  in  obt. lining  tlu-  simplest 
ilm  i  s  i  on  principles  possible  the  length  o!  a  signal  element  should  he  so  selected 
that  a  channel  uith  slow  fading  and  a  sin  it  memory  is  turned.  Obiiously,  in 
«  .it  r  gory  II  liannels  this  is  irpossihh-.  Ihis  circumstance  impose!*  important 
limitations  on  the  use  t  (  utegory  II  ihannels.  \s  V.  1.  Sil'urcn  { A  ]  showed, 
the  carry  inn  cap. nits  t  a  i utegory  1  eh. nine  1  approaches  infinity  it  thi  power 
ot  additive  interference  approaches  zero  while  the  carrying  capacity  ot  a 
fat egory  II  channel  under  thesi  conditions  remains  finite. 

In  what  follows  ue  will  consider  mainly  Category  I  channels. 

Several  Ideas  About  an  Optimal  Decision  Principle 

Ue  will  assume  that  all  distributions  of  probabilities  of  ...  (t )  processes 

n  1  k 

in  a  selective  fading  model  (or  .  (tj  in  a  multi  beam  model)  an  known.  Then , 
in  principle,  if  is  possible  to  apply  the  criterion  of  maximal  likelihood  so 
that,  based  on  arriving  signal  z'(t)  a  decision  is  reached  as  to  which  of  the 
possible  realizations  of  signal  :(tj  was  transmitted.  However,  because  of  the 
finite  memory  1.  of  the  channel  it  is  impossible,  generally  speaking,  to  limit 
ourselves  here  to  analysis  of  an  arriving  signal  over  interval  T,  inasmuch  as 
e.idi  element  of  a  transmitted  signal  creates  a  reaction  of  duration  I  *  I.. 
lherefore,  to  extract  complete  information  about  one  element  of  a  signal,  it 
is  necessary  to  carry  out  an  analysis  over  at  least  that  same  interval, 
furthermore,  it  must  he  borne  in  mind  that  in  the  con  posit  ion  of  a  received 
signal  there  is  simultaneously  a  reaction  over  several  elements. 

It  would  be  possible  to  extract  the  most  complete  information  by  analyzing 
a  received  signal  immediately  over  a  long  interval  of  time  and  by  reaching  a 
decision  about  the  entire  sequence  of  symbols  transmitted  over  this  period  of 
time.  However,  such  a  method  even  in  the  simplest  eases  is  exceedingly  dif¬ 
ficult  and  therefore  preference  is  given  to  e lement -by-element  (sequential) 
reception  which  can  be  described  in  general  terms  as  follows  [5],  A  segment 
of  a  received  signal  of  duration  T  +  I.  is  analyzed  beginning  from  the  instant 
of  arrival  of  a  new  element.  For  all  expected  realizations  of  this  element 
of  z^(t)  (r  =  l,...,m)  the  likelihood  function 

is  calculated  in  light  of  the  distribution  of  probabilities  of  multiplicative 
and  additive  interference  [i.  (t)  and  n(t)]  and  also  in  light  of  previously  re¬ 
ceived  decisions  about  symbols  preceding  the  one  in  question.  The  latter  is 
important  inasmuch  as  z'(t)  contains,  along  with  a  distorted  signal  element 
of  z ^ ( t )  and  additive  interference,  components  caused  by  N  preceding  elements 

of  the  signal  where  N  is  the  least  whole  number  which  is  greater  than  or  equal 
to  L/T. 
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is  reached  depend i ng  on  which 
greatest  likelihood  function. 


of  the 


realizations  of  the  signal 
,(t)  is  considered  re- 
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(7.15) 


Such  sequential  reception  is  not  optimal  inasmuch  as  use  is  not  made  here 
of  information  about  signal  elements  sent  after  completion  of  a  given  clement 
of  -j.lt. I  and  also  forming  components  of  the  segment  of  z'(t)  being  analyzed 

from  1  * o  I  ♦  1..  This  information  could  be  obtained  by  analyzing  a  longer  seg¬ 
ment  of  the  received  signal. 


Until  now  we  have  assumed  that  ill  distributions  of  probabilities  of  ..  (t) 

are  known.  In  tha*  case  when  they  are  not  known  and  only  certain  limitations 
imposed  on  ..  (t )  an  known  (for  example,  the  frequency  band  in  which  the  spec¬ 
trum  of  multiplicative  interference  is  lumped),  it  is  possible  to  construct  a 
principle  based  on  a  generalized  criterion  of  maximal  likelihood,  i.e.,  to  adopt 
a  decision  that  signal  element  z.,(t)  was  transmitted  if 


l- ‘  (II  .  ,<r.,  i-V'l  > 

Vt  (I  I 

>  mix  {.-'  |n„  ,  |  c,  in.  „  ,|. 

v,  in 


(7.1b) 


With  this  criterion  the  decision  princij  !e  is  that  first  an  evaluation  of  func¬ 
tion  ..^(t)  is  based  on  received  signal  : ’ ( t I  and  then  the  likelihood  functions 

are  calculated.  The  same  algorithm  can  be  deducted  from  criterion  (”.15)  on 
the  condition  that  .  ^(t)  and  ..^lt)  are  gauss  ian  processes  [6]. 


In  the  general  case  such  decision  principles  lead  to  exceedingly  complex 
functional  diagrams  [5]  which,  however,  are  greatly  simplified  in  certain  cases 
for  Category  I  channels  if  signals  are  properly  selected.  This  selection  must 
provide  for  the  simplest  possible  extraction  of  information  about  functions 

^  c  t )  when  a  selective  fading  model  is  used  or  ,.^*(t)  when  a  multibeam  model 
is  used. 


The  problem  of  selecting  signals  can  be  explained  from  another  point  of 
view.  A  signal  passing  through  a  channel  is  subjected  to  various  transforma¬ 
tions  which  are  both  reversible  and  irreversible.  In  the  case  of  irreversible 
transformations  there  is  a  partial  loss  of  the  information  contained  in  the 
signal  about  the  transmitted  message.  In  the  models  presented  multiplication 
by  random  functions  ..(t),  summation  of  the  output  voltages  in  branches,  and  the 
addition  of  additive  noise  are  in  the  general  case  irreversible  transformations. 
Nevertheless,  in  some  particular  cases  it  is  possible  to  select  signals  so  that 
some  of  these  transformations  are  made  reversible.  This  increases  the  amount 
of  information  obtained  with  the  reception  of  a  signal  and,  consequently,  in¬ 
creases  communication  fidelity,  lor  example,  if  each  realization  of  a  signal 
consists  of  a  small  number  of  harmonic  components  separated  by  a  large  frequency 
interval,  under  certain  conditions  the  received  signal  can  be  more  or  less 


accurately  separated  into  components  which  have  passed  through  separate  branches 
in  a  selective  fading  model.  Thereby  summation  of  output  voltages  of  branches 
becomes  (at  least  partially)  a  reversible  operation.  furthermore,  with  such  a 
possibility  of  separation  of  branches,  the  amount  of  received  information  is 
greater  than  in  the  case  when  a  signal  passes  only  along  one  branch  with  multi¬ 
plicative  interference.  SimiJarlv,  if  a  signal  amounts  to  short  impulses 
separated  by  long  intervals  of  time,  then  a  received  signal  can  be  separated 
into  components  arriving  along  various  branches  in  a  multibeam  model. 

In  subsequent  paragraphs  we  will  consider  various  particular  cases  of 
channels  and  certain  methods  which  permit  const  meting  relatively  simple  de¬ 
cision  principles. 

7.2.  Channel  with  Constant  Frequency-Dependent  Parameters 

The  simplest  case  of  a  frequency-dependent  channel  is  the  channel  with 
constant  parameters  in  which  the  transfer  function  II  (t,i)  does  not  depend  on  t 
and  therefore  can  be  designated  ll(i).  Included  in  this  case  in  the  first 
approximation  may  be  channels  in  which  1 1 ( t  ,  )  changes  very  slowly  with  t  so 
that  over  a  communication  period  which  begins  at  instant  t  =  t  it  -can  be 

assumed  that  !l(t,i)  =  1 1  ( t  ^  : J .  Most  electric  wire  uncommutab le  channels, 

also  long-wave  radio  channels  if  a  communication  period  is  sufficiently  short, 
and  ultrashort  wave  radio  channels  between  mobile  correspondents  when  communi¬ 
cation  is  conducted  within  the  limits  of  direct  visibility  are  all  included  in 
such  channels. 


If,  furthermore,  ll(t)  leads  to  a  do  1 1 a- functi on  ll(:)  =  *( 


t  )  (where 
P 


t  is  the  time  of  signal  passage),  the  parameters  of  a  channel  are  constant  in 

time  as  well  as  in  frequency,  i'll  is  case  was  considered  in  Chapter  111.  It 
corresponds  to  an  approximation  of  actual  channels  over  a  limited  period  of 
time  if  the  transfer  function  of  the  channel  (the  Fourier  transform  of  ll(ij) 
is  practically  constant  in  the  frequency  band  in  which  signal  power  is  lumped. 


We  will  consider  a  more  general  case  when  Ilf:)  is  not  expressed  even  ap¬ 
proximately  as  a  delta-function,  If  signal  n  (t)  arrives  at  a  channel  input, 

at  the  channel  output  the  signal  received  will  be 

i 

-’’(O'  j  --)<!-■  \"{t)  I  «(0  (7.1- 
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As  can  easily  be  seen,  the  problem  can  be  reduced  to  that  considered  >n 
Chapter  111  if  it  is  assumed  that  not  signals  :  (t)  but  changed  signals 

yatU)  if\t  ■ r.isi 

o 


are  sent  to 
should  only 


a  channel  with  constant  parameter 
be  borne  in  mind  that  signals  z' 


s  not  depending  on  frequency.  It 
(t)  have  a  duration  not  of  I  but 


of  T  +  I.  where  I.  is  the  response  time  of  the  channel  which  we  will  consider 
limited.  This  circumstance  is  usually  ignored  if  I  I  .  Otherwise  it  is 


- _ ^ iJ 


T-*r 


possible  to  construct  a  system  so  that  signal  elements  ot'  duration  I  are  sent 
at  intervals  of  time  T  +  I. ,  i.e.,  delays  of  duration  I.  are  introduced.  finally, 
if  I'  •  I.,  it  is  possible  to  send  signals  continuously  but  deliver  to  a  decision 
circuit  only  segments  of  a  signal  of  duration  T  -  I.  during  which  there  is  no 

overlapping  of  adjacent  elements.  Such  a  method  is  used  rather  widely  in  prac- 

*  i ce  and  is  called  the  protective  gap  method.  Of  course,  it  is  not  optimal 
since  it  entails  a  loss  of  information  contained  in  the  rejected  segments  of 

the  signal.  Incidentally,  when  T  "  I. ,  these  losses  are  negligible. 


I 
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In  principle  the  selection  T  ■  I.  is  always  possible.  In  order  under  this 
condition  to  provide  for  the  required  rate  of  information  transmission,  it  is 
essential  to  select  a  sufficiently  large  code  base  m.  However,  with  a  high 
level  of  interference  and  an  increase  in  m,  the  probability  of  error  grows, 
especially  since  in  a  chann  1  With  a  limited  passband  it  is  not  always  possible 
to  have  these  signals  orthogonal. 


We  will  consider  what  the  possibilities  are  to  reduce  the  response  time  1. 
and  to  select  an  optimal  shape  of  signal  providing  for  the  greatest  possible 
resistance  to  interference,  lor  this  purpose  we  will  use  the  method  of 
section  3.6,  namely,  we  will  introduce  two  quadrapoles  Ij  and  I  ,  (figure  '.SaJ 

where  Ij  has  the  transfer  function  modulus  ^(j,J‘  =  V;(j.)  and  the  trans¬ 

fer  function  modulus  of  quadrapols  ; coincides  with  V  (.  j  .  )  where  'i(j-)  is 


the  channel  transfer  function,  be  will  note  that  these  quadrapoles  are  plus 
ically  realizable  inasmuch  as  we  are  considering  a  physically  realisable 
channel.  As  can  easily  be  seen,  at  point  b  there  will  be  a  sum  of  signal 
s,  ItJ  and  gauss i an  interference  with  a  spectral  power  density  of  :  ,  (j ■  '  1 


v‘u.) 


and  at  point  b  signal  s.  ( t j  with  the  same  modulus  of  amplitude 


spectral  density  as  at  point  a  against  a  background  ol  white  noise. 


Reasoning  the  same  as  in  Section  3.6,  we  may  show  that  the  decision  cir¬ 
cuit  K'  connected  to  point  v  will  be  optimal  in  that  case  if  that  part  of  the 
circuit  within  the  broken  line  is  an  optimal  circuit  for  a  signal  at  point  h. 
The  latter,  as  was  shown,  consists  of  a  "whitening”  filter  which  in  this  par¬ 
ticular  ease  is  quadrapole  :  ,  and  optimal  decision  circuit  I’f  tor  signal  :  (tl 

in  the  case  of  white  noise. 


I 


II 


Figure  7-5 •  Pertaining  to  Conditions  for  Correction 
of  a  Channel  with  Frequency  Dependent  Parameters. 
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Signal  :  (t),  generally  speaking,  does  not  coincide  with  z(t)  inasmuch 

as  only  moduli  ot'  transfer  functions  are  defined  tor  quadrapoles .  The  se¬ 
quential  connection  of  these  quadrapoles  has  the  transfer  function 


</'(/«>)  (/>") </<, (/.»)  ( •■/>,  c'i<- 


("  •  1  i> ) 


where  .  f .  )  is  an  arbitrary  function  satisfying  the  condition  of  physical 
re a  1 i tab  i  1 i t  v  . 


Ihus,  sequential  connection  of  the  two  quadrapoles  ^  and  : amounts  to 


.i  phase  loop. 


If  it  is  desirable  to  reduce  the  length  of  signal  element  I  to  a  minimum, 
i is  advisable  to  select  .(..I  so  that  the  circuit  formed  by  sequential  con¬ 
nection  of  a  channel  ai.>.  a  phase  loop  with  transfer  function  (7.  IP)  has  the 
least  possible  length  .,f  transfer  function.  It  can  be  shown  that  for  tl  is 
purpose  the  phase- frequency  characteristic  of  the  resulting  circuit  must  he 
linear  over  the  ertire  range  of  frequencies  in  which  the  modulus  of  the  channel 
translcr  function  \(j.)  differs  f,-om  zero.1  Such  a  phase  correction  ot  a 
channel  characteristic  often  occurs  in  practice.  Khen  this  is  so  the  diagrui: 
shown  m  ligure  ".Mi  is  used. 

binci  tliere  is  normal  white  noise  and  signal  ;  ft)  which  amounts  to  the 

result  of  passage  of  the  initial  signal  ::(r|  through  a  circuit  with  a  transfer 

function  of  'l  ()  .  ie-1  '  "  '  *  at  point  c,  tb.e  greatest  resistance  to  interference  with 
i  given  power  of  signal  r.i  ti  will  occur  provided  for  when  the  power  of  signal 
1 1  i  -  mi.x  i  mu  1  . 


•I  his  assertion  is  valid  if  the  length  1.  of  the  transfer  function  Hit)  is  unde 
stood  in  a  mean-square  sense: 


who  re 


j  <••  y'V'-ou  ft 

n 

/  1 
f  in 
6 

T 

£  t/f  ’  (t)  .!% 
a 

I  r 

J  ir 


fSee  Note  3  at  t ho  end  of  the  Chapter). 
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Kc  will  select  any  value  T  exceeding  t he  length  of  impulse  response  ll(ij 
of  a  corrected  circuit.  Then  for  any  signal  ;(t)  of  length  T 

r 

.*  (/)  j//(/  (7.J0J 

0 

he  will  consider  the  following  lredholm  integral  equation: 

7 

^  //  (f  -)  V «.'*-)/ x  >ATk  (/I  (  -  _  J  1  ) 

It 

!:  has  solutions  d,  f t )  which  are  called  e i gen  1 unct l ons  for  cei:.ni  values 

K 

of  .  which  art  enumerated  in  decreasing  order  of  magnitude:  ,  _ 

\s  is  known,  (see,  for  example,  ["],  Appendix  II)  functions  4-^(1.)  )■  rm  a  com¬ 
pletely  orthonorma i i ted  system  over  the  interval  0  t  -  T.  fherefore,  any 
signal  can  be  expanded  into  a  series  in  accordance  with  these  functions: 


and 


7(7)  V'Urd'k 

*  1 


k  1 


Mihs  1 1  tut  i  ng  in  (".JU)  and  considering  (7 .21),  wc  obtain 

r  ^  *■ 

7  (/)  C//(.'  -.)  V  rt  1-)  ./x  V  1 7 » '  ►  ;  4  ( f )  • 

o  ai  r~; 

On  the  basis  of  ort hononna  ley  of  the  eigenfunctions 

T  t  )  or 

|  7  (7)  ill  V  (7  f  (,'i ,!:  V  a  > 
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from  tins  equality  it  is  apparent  that  transformed  signal  ;^(t)  will  have  the 
greatest  power  over  the  interval  (0  -  IJ  in  that  case  wiien  all  confidents  a. 

K 

are  set  equal  to  :eru  and,  furthermore,  when  it  corresponds  to  the  maximal 
eigenvalue  .  Iluis,  the  following  is  the  optimal  signal 

7li)  -*  (-.Jf,  ) 


where  a  ^  is  defined  by  limitations  imposed  on  signal  power  at  channel  input 

Us’r.g  both  signs  in  (".25)  we  obtain  an  optimal  binary  system  with  oppose^ 
signals.  After  signals  ;(t)  are  selected,  it  ts  easy  to  calculate  the  proba¬ 
bility  of  error  which,  in  the  case  of  coherent  reception,  is  equal  to 


P  '  l'  -- ■I’d '-jv.il 
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If  a  code  base  of  m  J  is  required  to  increase  the  rate  ol'  information 
transmission,  it  is  possible  to  use  several  orthogonal  forms  of  signal  which 
coincide  with  the  e  i  genfunct  i  oils  of  equation  (~.dlj  corresponding  to  the 
great  os t  e i genva lues . 

7. 3-  fast  General  Fading 

Another  relatively  simple  particular  case  of  the  channel  shown  in  figure 
",  1  occurs  when  transfer  function  ll(t,  l  can  be  shown  in  the  form  of  a  product 
of  two  cofactors  of  which  one  depends  only  on  t  and  the  other  only  on  •: 

//(/,  1!  |<  (/)//.  ftl  ("•  2b, 

The  first  cofactor  designated  u ft),  amounts  to  a  variable  transmission  co¬ 
efficient  and  the  second  cofactor  II.  (t)  is  a  constant  channel  transfer  function 

The  instantaneous  transfer  function  ( “ . 5 }  in  this  case  may  also  be  expressed  by 
two  cofactcrs: 

)’(«■>.  I)  |i  >'  (/•••l. 

v '  •  -  ■ ) 

where  ^ 

y I/***)  J //,(->* x i1  (  /'"-)'••• 

If  V(.u)  can  be  considered  constant  in  the  frequency  banc  in  which  the 
main  part  of  signal  energy  is  concentrated  and  the  dotation  of  a  signal  element 
f  is  much  less  than  the  interval  of  correlation  of  process  ..It),  there  is 
general  slow  fading  as  discussed  in  Chapters  V  and  VI .  In  this  section  wc  will 
study  the  case  when  ..  {.  1 1  changes  greatly  ever  the  length  of  signal  clement  T, 
i.e.,  the  case  of  fast  fading. 

In  communi cat  ion  channels  actually  used,  this  case  is  encountered  rarely. 
However,  it  has  many  times  been  shown  that  with  the  development  of  spac>  radio 
communication,  fast  facing  must  inevitably  he  considered.  Inasmuch  as  the  powe 
sources  for  signai  transmission  are  limited  and  fading  over  cosmic  distances 
is  gveat ,  the  length  of  I  must  he  increased  to  provide  for  a  high  ratio  between 
power  of  signal  element  and  spectral  noise  density.  As  a  result  T  may  exceed 
the  time  of  fading  correlation  [ v j .  Ibis  may  take  place  also  in  the  ease  of 
"ground"  shortwave  communication  when  because  of  certain  considerations  it  is 
necessary  to  transmit  messages  if  only  at  a  slow  rate  using  a  very  low -power 
transmitter.  If  in  these  eases  narrow-hand  signals  are  used,  it  is  possible 
to  ignore  the  selective  nature  of  fading  and  also  the  frequency  distortions. 

1 n  the  ch  nine  1  . 

In  the  ease  under  consideration  in  the  channel  model  shown  in  figure 

all  functions  of  .  .  Itl  and  ..  .  it  will  he  respcvtivelv  the  same  (with  an 
ck  sk 

accuracy  to  the  constant  coefficients  determined  by  the  transfer  function  of 
V(i  (.  Assuming  the  signal  to  he  so  narrow-hand  that  within  the  limits  of 
its  spectrum  >  f  1  j'  =  const  ,  it  is  possible  to  reduce  this  model  to  the  sim¬ 
pler  one  diown  in  figure  ~.o. 

-  '"9  - 


Figure  7-6.  Model  of  a  Channel  With 
General  Fading. 

It  can  easily  he  seen  that  such  a  circuit  can  he  obtained  based  on 

figure  7.4  if  ani|  ^  jn  ;ij]  branches  except  one  pair  are  equal  to  zero. 

Therefore,  the  concept  of  "general"  fading  and  "fading  in  a  single  beam 
channel"  coincide  completely. 


If  the  spectral  density  of  additive  interference  is  much  less  than  the 
power  of  a  signal  over  the  interval  of  fading  correlation  then  the  function 
,.(_tj  can  he  evaluated  with  great  accuracy  based  on  the  signal  received  by  using 
the  circuit  suggested  by  V.  I.  Siforov  in  calculating  the  carrying  capacity  of 
a  channel  with  general  fading  [9],  lor  this  purpose  the  harmonic  component, 
which  does  not  depend  on  the  information  being  transmitted  (pilot  signal),  is 
included  in  the  compos i t i on  of  the  signal.  Component  (tja  cos  .  t,  the  spec¬ 
trum  of  which  is  concentrated  in  band  . ,  determined  bv  the  rate  of  fluctuation 

in  transfer  coefficient  .  (t),  will  be  present  in  the  signal  received.  If  the 
spectrum  of  the  signal  components  carrying  the  information  lies  mainly  outside 
this  band,  it  is  possible  to  separate  the  pilot  signal  using  a  filter  and, 
inasmuch  as  the  transmitted  pilot  signal  is  known,  obtain  an  evaluation  for 
„(t,l.  After  separating  the  signal  received  for  ..(tj,  it  is  possible  with 
sufficient  accuracy  to  "eliminate-"  fading  and  use  a  decision  principle  for  a 
completely  known  signal. 


In  essence,  such  a  principle  amounts  to  an  idealization  of  the  method 
used  in  practice  of  instantaneous  automatic  gain  control  (l.\(!(l!  based  on  a 
pilot  signal,  l.rrors  occurring  due  to  the  presence  of  additive  interference 
in  the  pilot  signal  channel  and  also  because  the  spectrum  of  fluctuation  of 
..ft)  is  only  approximately  concentrated  in  frequency  band  ..  are  considered  in 
det ail  in  [ 9  |  . 


When  the  interference  spectral  density  is  great  it  i  •-  possible  to  use  the 
idea  expressed  in  the  work  of  John  Kostas  [s|.  This  idea,  if  the  terminology 
used  here  is  employed,  amounts  to  the  following.  \  signal  element  of  length 
T  is  broken  down  into  Q  "subelements"  of  length  T  -  T 'Q  and  time-diversity 

reception  is  conducted  over  ()  branches.  The  length  el  subelement  Tj  is  so 

selected  that  it  is  less  than  the  interval  of  fading  correlation  so  that  recep¬ 
tion  of  each  subelement  is  done  in  the  usual  way  under  conditions  of  slow  fading. 


7  SO- 
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As  a  consequence  of  the  small  ratio  between  the  power  of  a  signal  suhelement 
and  spectral  interference  density,  the  probability  of  error  in  the  reception 
of  a  subelement  will  be  great  but  ca'  be  decreased  to  any  given  value  through 
incoherent  accumulation,  i.e.,  through  t ime-di vers i tv  reception  by  selecting 
for  a  fixed  value  of  '1  a  sufficiently  large  I  Q’l  .  Of  course,  with  an  in¬ 

crease  in  T  the  rate  of  information  transmission  decreases. 

We  will  determine  the  probability  '  error  in  such  a  system,  he  will 
assume,  as  was  done  in  work  [S],  that  t:  ystem  is  binary  and  in  the  trans¬ 
mission  of  suhelements  relative  phase  i  Oat  ion-  is  used  and  the  fading  is 

Rayleigh,  furthermore,  we  will  assume  that  the  fading  in  the  subelements 
which  are  added  can  be  considered  independent. 

According  to  formula  (6.38),  in  light  of  Note  3  to  Chapter  Vi,  the  proba¬ 
bility  of  error  is  equal  to 

e  i 

P-  ,/v  c  -  /’•>*• 

*  (• 


where  p^  is  the  probability  ot  incorrect  reception  of  one  subelement. 

Considering  that  the  length  of  one  subelement  may  be  a  magnitude  of  the 
same  order  as  the  interval  of  fading  correlation,  probability  p.  can  be  deter- 

mined  from  formula  (5.76a)  by  substituting  in  it  for  h~  the  magnitude 
*>  1  ^ 


h“  =  1/Qh“.  As  a  result,  after  simple  transformations  we  obtain 

v  i 


,  l  A,  \ 

k 

f,U  k  f 

2  ^  /i„  1  Q  ) 

(7.28) 


where 


X 


Ah 


;W  - 


I  Q 


?  T 

"y 


■f 


and  R(t)  is  the  coefficient  of  correlation  of  the  process  ..(t). 

■fhc  dependence  of  M  on  Q  hinders  analysis  of  formula  (7.28).  If  it  is 
assumed  that  the  length  of  a  subelement  is  much  less  than  the  interval  of  cor¬ 
relation  x,  of  fading,  then  M  *  1.  In  this  case,  as  was  shown  in  Section  6.5, 
k  2 

for  a  given  h^  there  is  an  optimal  value  of  Q  providing  for  the  least  proba- 
bility  of  error.  Inasmuch  as  with  an  increase  in  Q,  M  increases,  it  is  possible 
lrrhis  means  that  signal  z  ^  ( t )  amounts  to  a  harmonic  oscillation  with  a  constant 
phase  and  in  signal  z_,(t)  the  phase,  with  a  shift  from  one  subelement  to  another, 
changes  by  180°. 
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to  assume  that  the  optimal  value  ol'  1,1  is  somewhat  givaKi  than  th.it  calculated 
under  the  assumption  that  M  =  1. 

In  work  1 8 j  the  problem  is  raised  o!'  determining  the  length  of  subelement 
I'  which  provides  for  a  maximal  transmission  rate  (i.e.,  a  minimal  T)  with  a 

given  probability  of  error.  It  is  shown  that  with  a  gnussian  correlation  func¬ 
tion  the  optimal  value  of  I  ^  is  equal  to  U.b  In  this  case  M  ^  0.75.  In¬ 

cidentally,  this  result  is  obtained  insufficiently  rigorously.  Specifically, 
the  decrease  in  probability  of  error  with  an  increase  in  Q  with  a  constant  value 

of  h“  is  not  considered. 

he  will  note  that  in  actual  channels  widening  of  the  frequency  band  due 
to  the  decrease  in  T  leads  to  a  situation  wherein  selective  fading  begins  to 

manifest  itself.  In  other  words,  with  si, .all  T ^  the  magnitude  L  of  channel  memory 

cannot  be  ignored. 

With  a  known  correlation  function  of  the  quadrature  components  1.^(0  and 
...  (t)  ,  it  is  possible  to  deduce  an  optimal  decision  principle  for  general 
fading  at  an  arbitrary  rate  [10].  I.et  the  received  signal  have  the  form 


r'(t)  |i,  (t)  Jr(t)  •- p,  (O’.  (0  f"  (0. 


(7.29) 


Wo  will  limit  ourselves  to  the  case  of  Rayleigh  fading,  i.e.,  we  will  assume 
that  „  (tj  and  a  (t)  are  independent  random  processes  with  a  zero  average  and 

the  same  correlation  coefficient. 


ft  ^  t  j  p-  ihbv  (M  (Mji.  (/.) 

(0  a,  (i i 


(7.50) 


Ihe  likelihood  function  for  signal  c^ft)  with  known  ..  (t)  and  ..^(t)  is  equal  to 


I 

|i,  (/),  (tj/ll  .V  exp  |  — ’ (/)  til  • 

U 

r  r 

-f-  V  f  M0-'(0-b  (0 '!(  !••;  j  n,(0 ’■(■')  MO* 

(I  0 

r  j 

-  v-  J  K  U)  (I)  dt  -  J  n;  hi:*;'  (/)  dt  - 

U  0 

r 

~  ,V  jhc  (I)  l‘.  (0  Cr  (0  C,  (t)d/j, 


(7.51) 


where  N  is  a  constant  not  dependent  on  r, 
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Substituting  in  (.“.oh:  tiu-  .  nidi  t  i  >  na  i  ptv!  ahi  1  i  ty  I". 5-1.',  find 


K  ('  »• 

/.  1  ’  (0  f 

?  T  ? 

I*.--  '  f  l.')r M0-'t  ^  K,„. 


%  h  o  re 


A',n  j  (.'i  .%(!)?„ 


r.  y- 


(0  (/)  r-n  (D'il- 


I ~ . en  ' 


The  decision  principle  based  on  rite  generalised  criterion  of  maximal  likoli 
hoed  amounts  to  recording  symbol  V.  if 


t"(/  'h  >“(-•■  -T.  !Sn,  k,,,. 

when  r  /-■/, 


X<vmKj>v  (a;.-!  >■;. 


( " . e8  I 


for  a  11  r  /  . 

On  the  basis  of  the  principle  obtained  we  may  construct  the  decision  prin¬ 
ciple  expressed  in  Figure  it  consists  of  m  branches  correspond i ng  to 


•  :V.." 


signals  z  ^ ( t  J .  In  each  branch  the  result  of  mu  It i pi  1  cat i on  of  arriving 
signal  by  :  (t)  applies  to  an  infinite  number  of  multipliers  where  multiplica¬ 
tion  by  functions  ;  (t)  is  performed.  The  products  obtained  are  integrated, 
as  a  result  of  which,  X , ^  and  Y,  are  formed.  The  subsequent  operations  are 
clear  from  (7.38). 


Figure  7.7.  Decision  Principle  for  a  Channel 
with  Fast  General  Fading. 

Of  course,  such  a  principle  is  unrealizable  because  of  ti-  infinite 

number  of  terms1  in  (7.3Sj.  However,  it  can  be  shown  that  tlv.  mean-square 

values  of  variables  X  and  1  with  an  increase  in  n  rapidlv  approach  zero 

rn  rn  1  '  1 

and  therefore  a  principle  using  a  finite  number  of  eigenfunctions  is  close  to 

optimal . 

Jumping  somewhat  ahead,  we  will  show  that  if  only  N  functions  :  (t )  with 

the  greatest  eigenvalues  are  used,  where  N  is  a  magnitude  on  the  order  of  I  . 

->  K 

(depending  on  h^J ,  with  further  increase  in  N  the  probability  of  error  decreases 
insi gni f icant ly . 

The  diagratn  shown  in  Figure  7.7  can  be  transformed  by  replacing  multiplica¬ 
tion  of  the  signal  and  regular  functions  by  passage  of  it  through  an  appropriate 

J By  transforming  the  decision  principle  (7.38)  it  is  possible  to  obtain  a  cir¬ 
cuit  which  does  not  have  an  infinite  number  of  branches  but  contairs  filters 
with  variable  parameters  [6,  10J. 


filter.  Figure  7.8  shows  several  variations  of  circuits  for  one  of  m  branches 

in  which  the  variable  X-  +  V-  is  formed  using  filters  matched  with  <1  ft) 

rn  rn  n 

(Figure  ~.Sa)  or  with  ;  (t)  (Figure  7.8b).  If,  as  we  have  supposed,  the 

spectra  of  functions  ;  (t)  occupy  a  frequency  band  lower  than  the  spectra  of 

i  (t),  we  may  show  that  is  a  signal  linked  with  the  product 

t  (t):  (t) .  this  permits  representing  the  decision  principle  in  the  form  of 

Figure  7.8c  not  containing  multipliers  in  which  filters  are  matched  with 
y(t)l  (tj.  Many  other  variations  arc  possible,  specifically,  a  circuit 

having  synchronous  heterodyning  and  filtering  using  an  intermediate  frequency. 
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Figure  7.8.  Several  Variations  of  a  Branch  of  a 
Decision  Circuit  for  a  Channel  with  Fast  General 
Fad i ng . 


In  the  general  case  all  these  circuits  are  very  complex.  However,  in  two 
particular  cases  when  i  ■  ^  and  when  T>  they  become  greatly  simplified 


in  the  first  ease,  when  fading  is  relatively  slow,  simplification  is 
obvious  inasmuch  as  we  may  limit  ourselves  to  a  consideration  of  one  eigen¬ 
function,  ,-|(.t).  It  can  easily  be  seen  that  in  this  case  the  decision  cir¬ 
cuit  shown  in  figure  7. Sc  is  the  same  as  in  the  case  of  slow  fading  (or  in  the 
case  of  absence  of  fading),  the  only  difference  being  that  the  filters  are 
matched  not  with  -t.(  t)  but  with  t  lie  product  ".^(t)  :  ( t )  . 

In  the  case  when  I  ■  -0,  as  might  be  expected,  :  ^  t  J  •  1. 

In  the  second  case,  with  orthogonal  signals  having  nonoverlapring  spectra, 
by  using  transformations  of  the  decision  principle  and  making  a  few  allowances, 
it  is  possible  to  represent  the  decision  principle  in  the  form  shown  in 
figure  ",(i  (see  Note  o.l  .  Here  tlv  hand  tillers  ^  have  a  ;  assband  on  the 

order  of  the  width  of  the  spectrum  of  the  f luctuat i ons  in  the  transmission  co¬ 
efficient.  They  effect  coherent  accumulation  of  a  signal  being  received  dining 
time  on  the  order  of  :  t  after  which  incoherent  quadratic  accumu  1  at  i  "ii  (addition! 

occurs  in  an  integrator.  It  can  easily  he  seen  that  this  circuit  coincides 
with  the  circuit  for  integration  following  a  detector  as  considered  in 
Chapter  IV.  At  the  same  time  the  idea  of  .lohn  kostas  as  described  above  i '• 
embodied  in  it  [S|. 


: 
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Figure  7-5-  Si'npliiied  Decision  Principle  1  u  Signals 
with  Non-Overlapping  Spectra  in  tao  Case  When  T  . 


In  order  to  evaluate  the  effect  of  rate  at  t..,.i:ig  or  prob.ibi  1  i  !y  ot  error 
we  will  consider  the  simplest  case  of  a  hinarv  svsti  ",  with,  an  act  i  %  e  interval, 
he  will  assume  that  the  s  i n ,  i  i  *s  .ire  i  rtlu  get  il  :  n  the  intcie-it  ied  -ei>si-  and 
rthogonality  is  retained  i  Mowing  passage  through  i  Miannel  with  fast  fading, 
such  an  assumption  is  valid,  U  r  ev.ir.pli-,  for  an  II  svsten  with  a  large  t  re- 
quency  spread  and  also  for  signals  considered  in  the  work  of  .lohn  kostas  [fj. 

It  the  length  of  a  sole  lenient  is  much  less  than  ,  .  Ihe  decision  j  rinciple  nt 

t"'.As)  for  a  i'ina:>  svster  h.e  the  f >rr 
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Ko  rill  find  rlmirnts  of  the  eorrilatmn  matrix  ol  ran 
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j  I ...  r  o-  I  is  a  singular  matrix  of  the  N  order. 
Wu  will  find  t lie  roots  of  the  equation 


|  KA  xli  <h 


B>  using  the  method  ili'MTil',,1  i  Ft  l  to  i  h.ipter  i  i!  i  possjbh  ti  mid 

the  characteri  st  ic  function  atul  then  the  dcimti  of  distribution  it  i  ~  i  . 
rhe  probability  of  error,  i.e.,  the  probability  th.it  0  t  s  rqu.il  to 


pr>\ 


With  an  increase  in  N  this  probtibilitv  of  error  decreases  and  approaches  a  m.ig- 
nitude  determining  the  potential  resistance  to  interference.  lor  I  \  if 

condition  1  h’’  ''  f  is  met  t*o r  all  n  ■  \,  it  is  possible  to  obtain  from  ("'.•II 
n  0  -  1 

the  convenient  approx imate  formula: 


'•:,v  i 

P  '  H  • 

H(N) 

h  t 


In  the  particular  case  when  the  function  of  f adieu  correlation  is  exponent i a 

R(lt.  /.)  p’.  \;» ^ 

the  eigenfunctions  : n ( t J  are  equal  *u>  .see  [l~]  on  page  J 7 0 ) : 

?n(/>  \/  ,  cr. [»„(/-  7  J  j  ("  1.  r.  I.' 

where  .  are  positive  roots  of  the  equation 


n  * 

<*>',  '■*  i  • 

Figure  7.10  shows  the  dependence  of  probability  of  error  on  \  in  the  casi 
2 

for  h^  =  100  and  various  T/’j.  ratios.  These  results  conf i ra  the  fact  that  in 

practice  it  is  po: sible  to  limit  oneself  to  a  number  of  eigenfunctions  N  on  the 
order  of  T/*.  ^  . 

Figure  7.11  shows  the  dependence  of  probability  of  error  on  calculated 

for  a  rather  large  N.  As  can  be  seen  from  these  curves,  potential  res i stance 
to  interference  increases  with  an  increase  in  the  rate  of  fading  and  approaches 
the  potential  resistance  to  interference  of  a  channel  without  fading  (broken 
line  in  Figure  7.11).  There  is  nothing  surprising  about  this  since  the  greater 
the  rate  of  fading,  the  less  is  the  probability  that  over  the  length  of  signal 
element  T  unfavorable  ratios  between  instantaneous  signal  power  and  interference 
will  be  retained.  However,  it  should  be  kept  in  mind  that  with  a  selected 
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system  of  signals,  with  an  increase  in  t  ht-  rate  ot  lading  sootu-i  »i  latet  i  tu 
condition  ot  ortho^ona  1 1  t  y  will  bo  d  i  s  nipt  ed  tor  signal*-  which  pass  through 
tho  channel  ami  the  formula*;  used  to  calculate  the  cunes  p ro*.ont oil  will  no 
longer  hold. 
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figure  7.10.  Dependence  on  Probability 
of  Error  on  the  Number  of  Subchannels 
Used  in  a  Quas  i -Op  t  ima  1  Deceiver. 


In  cone lu< j  n,  wo  will  note  that  wilt 
core  practically  independent  inasr  ic'-  a^  ! 
cons i do  red  uncorre 1  a t  ed . 

7  .  I* .  Slow  Selection  fading 

In  tins  section  wo  will  consider  that 
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In  another  variation  [15  a  linear  qtiadrapole  Conned  by  a  delay  line  with 
taps  in  such  a  manner  that  all  arriving  beams  except  the  first  are  compensated 
for  is  controlled  based  on  a  tost  pulse  in  the  receiver. 

Che  test  pulse  must  be  sent  sufficiently  often  so  that  the  transfer  func- 
t i  on  lift  ,  : )  over  the  period  of  time  between  two  impulses  does  not  succeed  in 
changing  noticeably.  \  sufficient  amount  of  time  not  less  than  the  lenr'h  of 
the  channel  memory  1  (the  difference  in  movement  between  the  first  and  se¬ 
quent  beams)  must  be  allocated  fur  reception  of  the  test  pulse.  Natural!  .  in 
this  process  a  great  deal  of  the  t  ime  allocated  for  information  t  rails:’  i  n  is 
was  t  ed . 

It  is  easy  to  draw  an  analogy  between  this  method  and  \.  I.  Sil'ero.  ' 
method  which  was  described  in  the  preceding  section.  Indeed,  tin.  test  ;  ..  .a 

a  time  domain  acts  in  a  way  similar  to  that  of  the  pilot  signal  in  a  In 
domain.  In  one  case  unchangeab i 1 i t >  in  the  coefficient  of  transmissioi 
respect  to  frequency  (general  fading)  is  required  and  in  the  other  case  i  1  iti\e 
unchangeabi 1 1 ty  with  respe -t  to  time  (slow  fading; .  Ihe  pilot  signal  is  con¬ 
tinuously  emitted  but  occupies  only  part  of  the  assigned  frequency  band  while 
the  test  pulse  must  occupy  the  entire  frequency  band  of  the  channel  but  on  I  v 
part  of  the  time  used  for  transmission.  Both  methods  are  intended  for  i  clianik  1 
with  a  relatively  low  level  of  interference. 

Ihe  probability  of  error  tor  systems  with  a  test  puNi  .,nd  also  t  r  •  oral 
other  systems  in  a  multibeam  channel  are  computed  ill  works  [II.  1 .«  |  . 

\s  a  consequence  of  the  complex  it\  in  constructing  decision  circuit-  ui.uci 
conditions  of  r.ultibe.ir  propagation  main  designers  prefer  t  increase  the 
length  of  a  signal  element  in  order  to  knowingly  provide  f.  r  inequality 
I  ;  -  5)1  and  use  the  protective  interval  method  d'-.nbed  ;  r.  e.tier 
thereby  making  a  channel  a  single-beam  channel  with  s,|o.tive  tadim..  In  M\h  l 
to  provide  tor  the  required  high  rate  ot  in  format  ion  t  :  .u.sr.i  s  -  1 1  >n  a  u'o.  wit’, 
a  base  n  J  is  used.  Most  frequent  U  tins  is  don  1  v  methods  ot  ru  I  tipi'  '.tig 
cb,  nine  Is  (  1 1>  j  atnl  t  he  re  fore  such  sectors  will  be  .  •  i.leinl  m  ih.qtir  !\. 

In  shortwave  radio  channels  .ind  also  in  several  tlu't  ».  onnuni  c  it  i  :i  cliatinels 
.«  model  ot  multiboar  propagation  ,  s  not  sirpl.  a  .  diiuth  :it  “eth.'d  t  rer  i  <  sent  i  n« 
i  channel  but  reflects  the  plnsu.il  essetua  ot  passage  t  i  s  i  gn., ;  with  -uiti;  l< 
((flections.'  lor  such  channels  the  Irani  tor  tututi  :  mo  S*  s  ;t  •  ;  ,  e  r :  ;  \  w<  1  , 
apr  rox  i  mat  rd  by  a  sum  ot  do  1 1  a  - !  win  t  i  oils 

W  (1.  l)  ^  |i,  i  i :  /  <  | 


where  5  is  the  do  I  av  time  ot  the  ;-th  beam,  and  it  is  its  riM’siU  ~h  i »  h 

l 

changes  slowly  with  t  . 


This  formula  can  be  obtained  from  ; * .  I  1  t  it  ,  a; preaches  ivtinitv  f 
setting  *  ^  1  ( t  )  ,  ■  ..  ( t  )  and  cons  i  do  ring  that  several  ot  t  to  .o  t!  iui  i’t  - 


.  y«»  i  - 


(correspondi  ng  to  instants  of  arrival  of  actual  beams)  in  the  limiting  ease 
remain  finite. 

from  the  physica  model,  in  light  of  the  fact  that  functions  are  deter¬ 
mined  by  processes  in  .  trious  layers  of  areas  of  the  ionosphere  (or  other  re¬ 
flectors),  it  f  llows  that  ...(t)  can  be  considered  independent  for  different 

beams.  Below  we  consider  several  ways  of  receiving  signals  in  such  a  channel. 

Methods  of  Single-Beam  Discrimination 

\  significant  number  of  methods  proposed  to  receive  signals  under  multi¬ 
pith  propagation  conditions  are  based  on  discrimination  of  one  of  the  incoming 
beams.  Only  a  very  few  of  these  methods  have  found  practical  application, 
m.iinly  because  of  the  complexity  of  their  instrumentation.  The  discriminated 
!  e  in  (the  first  or  most  powerful)  is  also  usually  subject  to  failing,  but  this 
fading  is  now  general,  not  selective,  and  does  not  impede  transmission  at  very 
high  speeds .  furthermore,  the  failing  in  the  separate  beam  is  most  often  quasi 
v  ivU  igh  with  a  relatively  large  regular  component  ,  for  which  reason  reception 
fidelity  of  an  isolated  beam  may  be  substantially  greater  than  that  of  all  the 
interfering  beams. 

\s  early  as  the  I'd.iU’-  in  the  United  Statics  a  method  based  on  use  of  a 
re, citing  antenna  with  i  narrow  and  automatically  controlled  di rect i on.t  1  ;  itti 
■  -  the  vert  i  i  a  1  plans  ..MUM  -  -mult  ip  le  unit  steerabb  antennal  was  proposed  ir.d 
;  into  operation  in  several  long-range  diortwave  radio  common  l  cat  i  >n  lines. 

••'.a  :i;c  different  bear..*  arrive  at  t  hi  receiving  an.ti  nna  from,  di  ft’erer.t  angle 
lelatne  to  the  hori  .ton  this  antenna  can  discriminate  one  of  them.  Ihc  auto- 
r  it  ic  tracking  device  permits  the  seleition  of  the  most  "powerful"  of  the  i  r. 

'  r. g  bear  <  . 

In  the  s.ira-  t.ishien  the  use  et  mrr  wlv  directional  transmitting  and  n 
,  o.  mi  an’ er.r.us  in  communi  cat  ions  line  utilising  i  nosphvr i .  and  t  roposphori 
v  .ttcr  pen- 1 1  a  considerable  degree  t  e  I  nun  it  ion  f  the  -u!  t  ip.it!:  nature  of 
;  r  '0  ig.it  1 1  a; . 
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Pulses  omitted  by  transmitter 


Pulses  arriving  at  receiver 


Figure  7.13-  Multipath  Propagation  in  Short  Pulse 
Emission. 

We  would  note  that  this  sign'al  system  is  not  simple  because  when  expanding 
an  impulse  of  length  ■  into  a  Fourier  series  over  interval  T  a  large  (in 
principle,  an  infinite)  number  of  non -;ero  terms  results.  The  effective  fre¬ 
quency  band  occupied  by  such  a  signal  is  considerably  broader  than  in  simple 
systems . 

fhe  method  described  possesses  essential  defects  which  have  prevented  it, 
as  far  as  we  knew,  from  being  realis'd  in  practice,  at  least  in  the  shortwavi 
range  where  multipath  propagation  manifest  itse"‘  most  strongly.  The  great  st 
obstacle  in  the  way  of  using  this  method  is  the  difficulty  of  producing  suf¬ 
ficiently  shirt  pulses  of  the  power  neeessar  to  assure  the  requisite  fidelitc 
of  reception. 

It  is  not,  however,  at  all  obligatory  that  the  signal  he  of  an  impulse 
nature  for  the  receiver  to  be  afforded  the  possibility  of  di scriminat i ng  oiu 
of  the  arriving  beams .  It  suffices  for  this  that  the  signals  have  a  base  of 
J!  I  i  and  an  approximately  uniform  spoclr.l  density  in  froquone;.  band  1 
[., ’J.  -'itch  wide-band  signals  arc  otton  call--,'  noiso-liko,  although  in  reality 
they  ar"  complete!)  regular  and  1  now  ledge  of  their  structure  permits  them  to 
1  'e  di seriminated  from  noisi  in  the  receiver.- 

iiu  the  sale  f  di  ;  ;  n  1 1  eiu  *•  s  we  will  as«.ure  tb.at  signals  c  tt>  represent 

:  i  a  1  i  cat  i  ons  .  f  ,i  Nauss,an  piaci--.  !  !u  >  ,ai:  be  obt.iiiud,  for  example,  by  ,i 
r.u.dor.  independent  selection  of  dll  u  tin*  coet'f  i  v  i  ent  s  ol  a  lourier  series 
from  i  general  aggregate  with  <  normal  ;■  n  hab  i  1  :  t  y  di  -tribution,  core  rathe- 
i '  iv.il  expectation,  ami  .i  gi\er.  .Ii  qs  ei'  n  <f  1,1.  inasmuch  is  slow 

fading  i.  usule  r  cons  i  tie  rat  i  on  ,  we  .% 1  1  i  .  ohm  Jit  the  transfer  coefficient  .. 

'i 

i  m  each  bear  to  be  constant  random  “i.igniSudi  s  over  the  length  of  or.o  signal 
e 1 ement  . 


let  u*-  remark  that  nowhere  in 
esposially  stipulated  ex  ir.pl  es 
Jherrfori  ,  all  the  earlier  d«*r 
s  i  k  nil 


a  I  i 
w  a 

\  e,i 


the  preceding  chanters,  except 
th>  s;:e  op  the  signal  base  It 
n'uib  remain  true  also  for  m 


i  n  i  ,-e  !  at  ed  , 
mi 1 1  d. 
de  -band, 


Lot  us  demonstrate  how  one  of  the  arriving  beams  is  discriminated  in 
coherent  reception  of  a  wide-hand  signal.  Let  the  incoming  signal 


:'U)  V  ii.f.tf  —Mt)  |  n(l) 

i 


(7.53) 


(where  N  is  the  number  of  arriving  beams')  go  to  a  multiplier  (figure  7.M)  in 
which  it  is  multiplied  by  the  signal  coining  from  a  local  oscillator,  equalling 
z,(t)  to  a  constant  factor  of  accuracy,  and  synchronized  with  one  of  the  in¬ 
coming  beams,  fer  convenience  we  will  in  expression  (7.53)  read  out  the  lag 
time  from  the  mc.-  nt  that  the  local  signal  begins,  so  that  the  values  of  t. 

may  be  both  neg.ii.e  and  positive.  Alter  multiplication  and  integration  the 
comparator  svstir  will  at  readout  moment  t  =  T  receive  voltage 
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(7.5-1) 


In  contrast  to  the  case  of  the  single-path  channel  examined  in  Chapter  111 
expression  (7.5yj  contains  terms  which  express  the  result  of  integrating  the 
product  of  the  heal  signal  and  the  signals  ...z^t  -  At.)  which  arrived  by  dif¬ 
ferent  paths  and  with  a  lag  (or  a  lead). 
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Figure  7-1^.  Coherent  Reception  of  Wide-Band 
S  i  gna I . 

In  similar  fashion  the  voltage 

\  -  1 

^  (/  -  M,U:  :  [  (7.55) 

I  I  ‘  u 

at  the  readout  moment  will  enter  the  comparator  system,  coming  from  the  second 
multiplier  circuit  which  has  received  signal  z.  from  the  second  local  oscillator. 

Let  us  calculate  the  degree  of  correction  introduced  by  the  additional 
beams  into  the  multiplication  and  integration  results,  as  compared  to  a  single- 
path  channel,  for  this  purpose  let  us  examine  one  of  the  integrals 
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(7.5 6) 


entering  into  expression  (7,54).’ 


Representing  :  (t)  as  a  Fourier  series  over  the  interval  (0,1)  we  may 
write  this  integral  as 

T  i.  *, 

Jt  |1..'  1  V  I l/.nl-' •  blk  s:r.  V]  \:l,k  I'.iS  (/  • 

1  J  ,  7 


u  *,  *. 

Am  />,«/ :i\ ’Aujo  (/  A/,  >|  •// 
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(7.57) 


Let  us  now  take  into  account  that  signal  base  JIT  =  J(k0  -  k  +  1)  is 
•  1  ■>  *“  * 
large  and  tli.t  the  value  of  a“  +  b‘  is  about  the  same  for  all  subscripts  k 

(i.e.,  the  signal  lias  an  adequately  uniform  spectral  density  in  band  l;)  .  Here, 
obviously, 


o  .  O/t 

a  :  />  .  i  , 
»  1  »  i ij  r 


(7.5S) 


where  IV  is  the  power  of  the  signal  arriving  over  tin.  i-tli  path. 
Hence  it  follows  that 


J. 


r  .59) 


In  particular,  \t.  =  0  for  the  beam  with  which  the  local  oscillator  signal 


is  precisely  synchronised  and 


J>  l , 


(7.60) 


where  the  subscript  rec  denotes  the  beam  received. 

In  the^general  case  where  \t .  i  u,  let  us  transform  expression  (~.59)  by 
designating  m  =  k  -  kj  +  k.,/2  =  k1-  k  -  IT  -  1/J  (or  with  even  FT,  the  nearest 
whole  number) .  Then 


'Strictly  speaking,  expression  (7.54)  is  true  in  the  case  where  the  preceding 
(when  t.  •  0)  or  the  following  (when  t.  ■  0)  signal  element  is  also  :]-(t). 

Otherwise  the  integral  must  be  broken  into  two  parts,  from  0  to  .\t .  and  from 
,‘.t.  to  T  (when  at.  ■  0),  where  in  the  first  of  these  :^(t  -  it.)  is  to  be  sub¬ 
stituted  instead  of  i^ft  -  it.)  if  the  preceding  element  was  tj(t).  This  re¬ 
finement  docs  not  affect  the  qualitative  result  which  will  be  obtained  below. 
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Ip.  t'.iv  t  ,  when  M  !  the  denom  i  n  a  t  o  r  of  exp  it  ^  :  on  i  ".(  '  chanm  s  much 
slowly  than  the  numerator ,  ami  t  he  re  fore  the  positions  et'  the  maxima::  of 
the  quotient  almost  coincide  tilth  those  ot  the  maximum  of  the  numerate:-,  Ihe 
greatest,  of  these  max  imams  corresponds  to  k  !, 


and  has  tin  value  iwheii  1  1 


M, 
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i  1 
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i,-i 


1 1 


i.e.,  subs t ant i a  1 1 y  less  than  the  principal  max  i  rut:,  which,  is  unity.  ihe  other 
maxi  mans  have  even  smaller  values. 


y 


Half  of  the  peak  width  at  t.  -  0  may  be  calculated  by  finding  the  first 
at  which  express i on  (7.03)  becomes  tern.  This  occurs  when 


alue  of  't 


I' her  of  ore ,  all  the  beans  leading  nr  lagging  the  liiitdanont.il  foam  K  rmi 
than  1/i  create  only  very  -.nail  potent  i  a  1  s  at  the  output  ot  the  mu  1 1  i  p  1  i  r  i 
circuit. 


!  it  the  second  multiplier  all  the  heap*  civ  ate  a  voltage  hlucli  1  s  i»p:i'M,l 
In  the  first  term  vif  formula  i'.Ss  .  bill's  1 1  tut  un1  in  it  ;  It  t  i  am! 

i 

Z.(t)  in  tile  form  of  a  I  miner  series,  we  nav  <how  that  Ini  the  i-th  iu-a  t'.m 
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ivlien  .  t  ^  =  (J  (i.e.,  for  the  fundamental  beam)  this  expression  equals  zen 

for  signals  which  are  orthogonal  in  the  intensified  sense,  lor  the  other  beams 
it  differs  from  zero  and  with  a  random  value  of  t.  it  represents  the  sum  of  a 

large  number  ot  random  terms.  lhis  enables  us  to  regard  the  probability  distri¬ 
bution  of  .! I  as  approximately  normal.  In  other  words,  all  the  beams,  except 

the  one  being  received,  act  upon  the  receiver  in  about  the  same  way  as  normal 
fluctuation  noise  of  uniform  spectrum  in  frequency  band  1 . 


l.ct.  us  calculate  the  power  of  this  extra  noise.  It  is  obvious  that  it  is 
always  advisable  to  discriminate  the  most  powerful  incoming  beam.  Let  us, 
however,  examine  the  worst  case  where  N  beams  of  approximately  equal  intensity 
arrive.  Then  the  extra  noise  power  is  about  (X  -  J ) . 

At  fi rst  blush  it  may  seem  that  this  noise,  several  times  greater  than 
signal  power,  would  completely  disrupt  reception.  This  would,  in  fact,  have 
happened  with  small-base  signals,  but  when  FT  ••  1  and  with  optimum  or  close'  to 
optimum  methods  of  reception  this  noise  has  little  effect  on  reception  fidelity 
because  its  power  is  evenly  distributed  in  frequency  band  F  and  the  complete 
spectral  noise  density  rises  by  only  ( (N  -  1)1’  }/F. 

If,  leaving  multipath  propagation  out  of  account,  the  received  beam  peimits 
a  signal  power  to  spectral  noise  density  ratio  of  h“  =  ps/*vq>  the  harmful 
effect  of  the  remaining  beams  will  decrease  this  ratio  to 


A'*  •- 


r,r 
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■  I)  h’ 

FT 


equalling  a  power  loss  by  a  factor  of  I  -j-  I'.l  t;mes 


(".05.1 


The  additional  noise  arising  in  a  certain  communication  svstem  is  usually- 
called  system  noise. 
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.  t  ;■>  lu!  at  'll  no  o".in  t  or.p  lo\  >.  oh«  J  ent  to  >  opt  i  on  To  >!;  m  n-irati'  a 

1  oar.  in  wideband  signals.  It  is  c.im  To  That  tlu  >.ir.i  rosult  na\  In'  o!  - 

t  1 1  ikm.  ,  !'■ '  r  instance,  In  a  quadrature  M'-tetr,  u:  incoherent  reception,  which 
•  I’oviJi's,  ,n  was  shown  in  precedi  ng  chapters,  almost  tin-  same  fidelity  as 
coherent  io  cop  t 1  on  .  Moroovor,  tlus  makes  the  ooiulitions  for  synohron  i  :  ing  the 
local  signal  with  the  incoming  beam.  Whereas  in  coherent  reception  this  synchro¬ 
nization  must  he  accomp  1  i sheil  with  iccuracy  to  a  small  fraction  of  the  average 
signal  frequency  period  (which  is  technically  unrealizable  in  many  cases),  in 
(uadrature  reception  this  exactitude  is  limited  only  to  the  width  of  the  basic 
peak  in  expression  (7.031  ,  i.e.,  need  he  on  the  order  of  a  fraction  of  1/1'.  As 
signal  band  width  increases,  the  requisite  synchronization  accuracy  grows  larger. 
Another  variety  of  incoherent  reception  of  widc-band  signals,  which  is  based 
on  the  synchronous  heterodyne  method,  is  used  in  the  "Ibake”  system.  As  concerns 
the  results  obtained,  this  system  is  in  no  way  different  from  the  quadrature 
method  and  demands  the  same  precise  synchronization. 


There  are  possible  methods  of  incoherent  reception  of  wi de-band  signals  with 
single-beam  discrimination  which  solve  the  synchronization  problems  more  simply. 
Among  these  we  find  the  variant  of  optimum  incoherent  reception  based  on  linear 
filters  matched  with  the  signals. 


Since  the  matched  filters  are  linear  the  principle  of  superposition  is 
applicable  to  them  and  the  effect  of  each  beam  in  isolation  may  be  examined. 
Because  the  pulse  response  of  the  filter  matched  to  signal  z^ft)  is  g(t)  = 

=  iz  (T  -  t )  ,  where  i  is  an  arbitrary  proportionality  factor,  the  filter's  res¬ 
ponse  at  moment  t  to  signal  z^(t  -  At.)  delivered  at  moment  At.  may  be  precisely 
found  to  a  constant  factor  by  Duhamel's  integral 
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l.et  us  exchange 
the  notation  At’  =  T 


the  variable,  designate  T  - 
-  t  +  At. .  Then 
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t  +  X  =  y, 


(A."-- (7), 


and  also  introduce 
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liu-  graph  of  tin.-  envelope  of  this  function  agrees  with  the  airu--  in 
I  injure  ".la  it"  t  *  ‘t  -  1  is  laid  off  along  the  x-axis  instead  ot  t  .  Ilu  s 

envelope  hence  has  a  sharp  peak  on  the  order  of  J / 1  hide  at  moment  t  1  ♦  t  . 

l.ach  incoming;  oeani  forms  its  own  peak  at  the  proper  moment  and  if  t  ho  trawl 
distance  between  adjacent  he  tuns  is  no  less  than  2/ !  these  peaks  are  not  super 
imposed  on  each  t’Tier  (I  igure  ".loj  and  therefore  do  not  interfere  as  in  the 
case  of  narrow-band  signals.  1  ’ v  combining  the  moment  of  readout  with  the  greatest 
peak,  single-beam  reception  may  be  accomplished. 


Figure  7- lb.  Voltage  Envelope  ot  Output  of  Filter 
Matched  to  Wide-Band  Signal  Being  Received  in 
Multipath  Propagation. 

The  power  ratios  in  a  circuit  with  matched  filters  are  the  same  as  in  co¬ 
herent  reception  inasmuch  as  all  the  incoming  beams  set  upon  filters  matched 
to  other  signals,  about  like  fluctuation  noise. 

Methods  of  Utilizing  Several  Beams 

The  described  methods  of  single-beam  discrimination  enable  us,  at  least  in 
principle,  to  get  rid  of  interference  between  incoming  beams,  i.e.,  of  heavy 
(.Rayleigh)  selective  fading  and  of  echoing;  but  the  fidelity  of  reception  by 
these  methods  is  determined  only  by  the  power  of  the  single  discriminated  beam. 
The  question  naturally  arises  whether  it  is  not  possible  to  use  our  knowledge 
of  the  structure  of  the  multipath  signal  to  separate  the  incoming  beams  and 
add  them  in  such  a  way  as  to  get  the  whole  power  of  the  entire  signal  and  thus 
i  ncrease  recept  i  on  f  i  tie  1  i  tv  . 

The  addition  of  incoming  beams  may  also  employ  wide-hand  signals  which 
permit  the  incoming  beams  to  be  separated  [21,  28],  This  concept  has  been  put 
into  practice  in  the  already  mentioned  Rake  shortwave  system  [ 1 S J  .  Figure  7.1? 
presents  a  simplified  block  diagram  of  the  Rake  receiving  unit.  As  already 
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F  i  gore  7.17*  S  i  nip  1  Hied  Block  Uiaqrar’  ot  -eceiii’a  Unit  in 
the  "Rake"  System.  Key:  I,  From  measuring  filter  6;  2,  Siqnii 
generator  z  f  ( t )  ;  3,  Signal;  A,  Delay  line;  3 ,  Measuring  f:lter; 

6,  Auxiliary  generator  ;  7.  Kinematic  t  i  1  t  e  >  ;  3,  Detect'.'', 

9  ,  Comp  a  r  i  ng  device;  10,  Detector;  II,  K '  non  a  t  '  c  ‘  :  1 1  e r  .  It  , 

Dec i s ion . 

I  he  received  signal  goes  to  a  del.>y  line  whose  t:  in-  .  t  tire  '  « 

less  than  maximum  relative  t  i  me  lag  t  of  the  beams  under  coils  ■  de  r.it  i . 

rax 

and  in  the  given  system  is  a  msec.  I  hi  -  line  has  t  .  lays  >,  l ..  t : .  s 

intervals  of  1  !  ,  i  .  e .  ,  lilt'  mi  crosec  .  llu.s  ,  the  total  nut, bet  of  t  ry  ■  . 

sides  is  '  t  I'  T  30.  I  lie  tap-  are  oifictid  t ..  the  :  i  t  i  p  1 ;  i  r-  \  ' .  t ! 

max 

multi  pi  iers  -pf  the  top  tap-'  is  fed  a  .ullage  frei:  iai.i  1  igr.ai  cell*  r..t ,  r 


and  to  those  of  the  bottom  taps,  fn  -  the  local  gei.erutir  <n 1  .  .  ■  . 

! he  local  signal  generators  an  "o  syiuliroiii  ted  that  the  '•eg;  of 

their  element  coincides  with  the  monuit  the  beginning  of  the  eloretr  of  t!.e 
received  signal  which  has  traverses,  the  shortest  path  appears  at  the  last  tap 
of  the  delay  line.  Then  at  the  last  pair  of  multipliers  there  rppeur  vultures 
which  contaiiv  frequency  component  ,  (.See  Note  1  to  Ch.iy  ter-  1\  •  uni  w  i  t 1  a; 

amplitude  proportional  to  valms  of  V  ( 4 ,  1  1  j  and  cone  pom:  i  ng  t;  tin  ::.a\i!M;n 

of  the  curve  in  figure  7.  IS.  The  remaining  beams,  provided,  tiny,  lag  the  this! 
by  more  than  1/P,  will  generate  no  perceptible  voltage  of  frequem;.  (  in  the 


-1 0-1  - 


I 


last  j'.u  r  ot'  multipliers,  bci.iuse  tor  then  the  .ilvi  i<.s.i  o!  the  iiinr  it 
figure  ~ .  1  >  lies  outside  the  pr  i  tu  t  pa  I  maximum.  ftul  each  1  -»C  *:  1  r>»:  hear,  n  .it 
sore  one  tap  synchroni  zed  with  the  Uu.il  signal  generator  with  an  .uojr.io  i! 
no  worse  then  1  I  and  generates  voltages  of  frequincv  ^  at  its  » orrespondmg 

multipliers  ami  with  ar.p  1 1  tildes  proportional  to  the  i.iIiis  of’  \  tor  that  hi  ar 

Ihus,  the  sene*-  ot  multipliers  ear.  obtain  ilot  nn  t  etfeits  t  ror  the  in 
coning  hear.s.  Hut,  on  the  other  hand  .  n>ost  ot’  the  mu  1 1 :  p  1  ie  rs  do  not  eitiih 
the  stipulation  of  synchronism  and  voltage*-  are  segregated  on  ther.  whivh  are 
general  ed  on  I  v  bv  no i-i  , 


I  he  voltage  ot  fre.juencv  ‘  t  ror  the  output  ot  each  r.ultipliet  go  to  a 

seeond  r.ultipliei  "iveri  I  ,  t  i  the  second  input  ot  which  is  led  a  voltage  ot 
frequency  -  .  frit,  a  measuring  filter.  this  voltage  also  has  all  amplitude 


app  ro.v  l  rat  e  1  y  proportional  to  the  mean -square  value  II  ot  the  voltage  generated 

In  the  i orres ponding  beam.  (here  is  a  measuring  filter  of  this  sort  in  the  c  i  r 
cuit  of  each  pair  of  taps.  Iigure  " .  1 -  shows  the  connection  of  this  filter  only 
for  the  last  pair  of  taps.  it  consists  of  the  following:  the  voltages  of  t’re 
quency  '  obtained  at  the  output  of  the  multipliers  of  a  given  tap  are  added 

and  fed  to  mixer  s' I ;  there  they  are  rived  with  the  osc  l  1  1  at  tons  ot  the  auxiliary 
generator  of  sinusoidal  waves  of  frequency  ,  l common  to  all  the  tapsi.  and  flu 


emitted  oscillations  ot  frequency  ^  ,  are  fed  to  a  narrow -baud  measuring 

filter  whose  passband  is  of  the  order  of  I  eps  (matching  the  fluctuation  rate 
of  the  state  of  the  ionosphere).  Iherefon  the  voltage  at  tlu  output  ot  the 
filter  is  almost  independent  of  muse  and  m  determined  by  the  power  of  tlu 
corresponding  beam.  In  particular,  at  the  output  of  the  filter  of  the  tap  in 
which  not  one  beam  was  synchronized  with  the  signals  of  the  local  generators 
this  voltage  is  practically  zero,  hence  there  is  likewise  no  voltage  at  the 
output  of  the  multipliers  I  of  this  tap.  \s  for  the  circuits  of  the  "active" 
taps  in  which  a  certain  beam  is  separated,  then  at  the  output  of  the  multiplier*' 
B  there  are  voltage  of  frequency  and  amplitude  approximately  proportional  to 
the  produce  V  U  . 


’I he  initial  phase  of  the  voltages  of  frequency  . ,  at  the  outputs  of  the 

multipliers  B  at  all  the  taps  is  the  same  and  agrees  with  the  initial  phase  of 
the  auxiliary  generator.  We  easily  satisfy  ourselves  of  this  by  tracing  all  the 
frequency  conversions  through  the  circuit  and  taking  into  account  that  the 
initial  phases  are  transformed  in  tlu*  mixers  (multipliers)  just  as  are  the  fre¬ 
quencies.  Therefore,  by  feeding  all  these  voltages  from  the  upper  t aps  to  one 
common  bus  and  all  the  voltages  from  the  lower  taps  to  another  common  bus  we 
can  arithmetically  add  the  amplitudes  of  tlu*  currents  resulting  from  the  pro¬ 
cessing  of  each  beam.  Therefore  we  are  here  practically  effectuating  almost 
coherent  addition  of  the  individual  beams  (accurate  to  the  noise  at  the  output 
of  the  measuring  filter). 


The  thus  added  voltages  from  the  Zj  and  z,  signal  buses  go  to  kinematic  fil¬ 
ters  tuned  to  frequency  ,  and  screening  out  the  other  harmonic  components,  are 


thru  and  in  loqurr.!  in  .1  ioq'.ir.i(or.  In  this  Jitcvtnm  t  he  111!  r 

b.i!  ton  about  sipnal  ph.-no  is  lost.  therefore  the  fal  o  rcuuiE  jM-rterrs  in 
sohoron!  Jell  v  1 1  on  o!  the  sipnal  obtained  free  coherent  addition  o’  •  h«  lo.i?' 

iMscrete  n«  nor. it  or-  of  binars  Mi|ui-nuoi  in  shit!  repixters  with  teedh.ivl 
iro  used  in  tho  Rake  sistrs  to  shape  wide  hand  ihum-  litr  sipn.ils  |  »n  .  tor 
example  (;0|  "'lull  .1  pener.it  or  «*r  1  t  s  .1  sequence  ot  pulse*  t  comIiu  it>! 

nop. .it  1  \  o  pi'l.m  h  with  .1  1  enp t  h  0 1'  0  .  I  -iiii"oi  <  u  n  *« .  '■  rnri  M-i  Ih<  p<  n  <*d 
of  .1  sequence  1  out  a  I  ris  lO.'x  pulses  .ifu!  lasts  r.ok.  I!  1  exceeds  th< 

■.i>irur  prop.ip.it  1  on  ii  1 1  to re  nee  ohserxed  iti  tho  sh.ortw.no  bund 

Iho  pnlsos  rovoisoil  .iro  delivered  to  .1  filter  with  .1  pashainl  o!  In  K  it 
tin'  output  oh  which  tlu-  noiso-lili-  voltupe  is  sop.ir.itoi! .  I>  lr,  n  .m  tho  po.il 
!  .lot  or  this  \eltapc  is  lintoil  with  rospoot  to  naxirur  and  Jinn  poos  ti  another 
tiltor  also  havinp  .1  passh.md  ot  |c»  » 1  .  Inasmuch  .is  tho  potto  t  at  ors  t  tho 
pul  so  sequences,  hiltirs,  ,uul  I  mi  tors  in  tho  t  ransrv,  1 1  1  np  and  rou  n.tip  d<  - 
i  iios  .iro  tho  sane,  it  is  possible  to  oht.iin  practical!)  i.lotitn.il  muse-lilt 

\  O  1  t  .IpOs  . 

I'\  sfipionti.il  t  r. ms torr.it  nrps  tho  t  requeue  1  os  torr  .1  sipr..,  I  in  tlu  uortinp 
h.itul  ot'  h requeue  1  o.s .  Iho  s.m.o  noise- like  \olt.ipo  m  uso.l  t.  oht.iin  sipnal  p.ur 
;  I  ’  .irnl  :,(ti  hut  tlu-  averapo  lrn|min  us  ilittor  t>\  !  1  *  !  .  s  cp*.  Hus 

porrut  s  noilu  I  .it  1  on  in  tho  t requeue*  t  runs  J  om;  np  it.uit  •  tlu  t ransni t T 1 np 
hot  1 00 . 


Iho  lonptli  ot  oloront  I  msec  I  h  is  n c> t  equal  to  .uni  mi  .1  ri.Iti;  Ii 

oh  tho  lor.pth  ot  tlu  j  ■  r  1 1  >»!  ot'  flu  ponor.itor  oh  tlu-  tmt  so  hlo  -ipnal.  Howe'er, 
this  does  not  .liter  the  conditions  ot  optin.il  inoohormt  reception  inasmuch  a* 
with  sytu-hroni  ;oiI  huiuti  nmp  oh  tho  ponor.itors  in  tho  t  runs.- 1 1 1  1  m;  and  recininp 
iloxioos  reception  ot  e  ich  eler.'nt  .mount  s  to  adopt inp  1  decision  .n  tt  wh.ch  >  !‘ 
twi  sipn.ils  was  t  ransn  ttod  and  fh<  shapes  oh  tho  expected  stpn.ils  arc  Inown 

(with  tho  di'proo  ot  s\|  hronisr  at  t  a ;  n.ih  It  in  practice  with  an  .uair.10  to  tin 

initial  phase!  altlmupl  tiles  an  dihheretit  tor  different  elor.ents. 

It  the  number  <h  ro  cnod  hears  and  the  ratios  ot  ipnal  power  to  spectral 
noise  density  are  known  n  each  hoar.,  the  prohuhilit'  ot  error  max  he  calculated 
t’ror.  ho  mu  l  a  (’.<>'!. 

Inasmuch  as  the  period  oh  a  noise- like  sipn.il  m  s,;,j.,  msec  more  thin  the 
memory  oh  channel  I  (which  s  ,1  shortwave  radio  channel  coincides  with  the  pro- 

papation  difference  between  he  first  and  subsequent  hears  md  usual  lx  does  not 

exceed  -  f»  msec  I  .  the  sipn.ils  irrixinp  In  different  paths  to  tlu  rrceiu-r 
an  almost  ort  hoponal  repardle -s  f  the  letipth  oh  o’ orient  i.  II. is  permits  m 
principle  increasinp  tho  rated  transmission  speed  in  a  nultihoam  chanm  1  when 
there  is  appropriate  widening  ot  the  frequency  ''and  I  To  preside  a  sufficient]) 
larpc  base.  Incidental!),  it  she  ild  he  borne  in  mind  that  with  1  hreiiuence  hand 
preater  than  appro.xi  mat  e  I  y  100  KM.  the  transfer  function  of  a  w  i  dc -band  rad  1  o 
channel  may  not  he  approximated  by  formula  since  the  diffuse  natun  of 

each  reflected  beam  hep  ins  to  take  1  fleet  and  the  do  1 1 .1  -  fund  1  on  rust  he  r< 
placed  by  transfer  functions  of  fini’e  lonptli.  In  such  a  situation  the  s  1  pi  il 
must  he  subjected  to  more  complex  pr<  "essmp  than  in  the  Rake  svstem  [ .' J  . 


-  I0t> 


.n  t  hi  iuiinii,  Jriiu  r  in  i  j'it  .1 1  is  .inf  1  i  J  i  vs!  .Uni  :  t  *>  s  i  s :  i  mi;  -lu  1  r  - 

t  y  t  hi  .i/i  e  r  age  t  r»  quelle  \  1  l  V,  .  lhi-  r  t  is  i  ti  g  t  req.iuenc  1 1.  i>  Iiowm  m 

liguic  .1'  .in-  y  Ul; ,  .  -  A  »fi: .  I'hv  -f.iiur  nig  filters  arc  tuned  to 

il 

t  requciu  >  11  IJ I :  and1.  have  a  passband  tn  the  order  of  I  /.ps  V ’  ] 

m  1 1 t  i ;  I  1 1*  i  s  ir.i.nfs  ,,s>  (  \  *  itu-s  .ir.l  pro- i  de  t  or  lineality  m  thin  th* 

limits  nt  .i  dynamic  un^r  I  UHj  .11 

\  system  tor  riM'ii  .nt  n.k'  band  1 1  ^ru  -  .*u.J  1  i  designed  /.huh  would 

peituir.  uuiilu  len!  addition  ot  thr  incoming  t>  >  aims  f .  im  .ms  .  I  m.it.h<-d  t  lift  7 

\s  ;lu  I’fc.  mini,  m\  !  li’l.  Jrr.i  list  I'.iti'J  ,  thr  1*  •  pc  eti. elope  /it  *  hr  nU.uf  l! 

.i  !  i  1 1 e 1  .itched  to  transmitted  signal  ,  ^<?  '  .i'  pt  .d  report  c  "fu«  1  to  !  Iio 

\  .iluo  of  \  tor  o’,  i'  ri  bear ,  .irul  ttvov  >lo  ri  •  t  -i.itu.illt  osetlan  it  tho  Jittor«iw« 

ft  couric  ot"  t Itc  adjacent  hearts  exceeds  1  ft  .  Hy  detecting  this  envelope  tilth 
a  quadratic  detector  and  feeding  tin  detest  i  result  to  a  capacitor  m  .ii. 

under  certain  conditions  oltatn  a  voltage  pt  ortion.il  t.  tho  sun  1  t!w 
squares  ol  these  values  tor  ill  the  incom.ng  hears. 

figure  ".IS  shows  sikIi  a  sister,  lor  receiving  wide  hand  s  ,  gnu  Is  when 
I  •  1..  Here  the  c.ipasilor  charges  Jtuctly  by  the  diMet'eiue  between  the  two 
detectors.  It  is  connected  to  the  detector  circuit  at  moment  1  f  the 
enJi  up.  of  the  element  tn  the  first  of  the  .*  r  r  i  \  i  n>;  beans  and  remains  sonneit  d 
fo:  tune  1  .  At  moment  I  •  1  tho  voltage  on  the  capacitor  is  read  out  and  a 
decision  is  reached  as  to  the  signal  transmit:  d  based  on  its  '  i  i;n .  V  t  ter  thi'- 
the  capacitor  is  di sconn* cted  fror  the  detect  :  circuit  and  at  moment  I  «  I 
(where  •*  T1  di  sch. i  rp.es  m  readiness  u  .ene  the  next  element.  Ib.i 

curves  show  th”  voltages  ,u  different  points  m  the  circuit  in  reception  ol 
ser  1  i  s  of  SI  gn.l  Is  ;  •  ,  ;  .  . 

\t  first  blush  tins  system  of  reception  is  simpler  than  the  It. ike  method, 
'specifically,  here  the  requirements  tor  synchronisation  of  transmitting  and  re¬ 
ceiving  devices  are  less  rigid.  Ilowevei,  it  is  necessary  to  consider  that  a 
filter  matched  with  a  complex  signal  n  far  from  being  simj  le  [ 19 ] . 

Ihe  probability  ot  error  in  any  syste:..  with  beam  addition  depends  cn  the 
number  of  beams  and  on  their  intensity.  If  the  number  of  beams  is  known  and  th 
ratios  between  signal  power  and  spectral  noise  density  in  each  beam  are  known, 
with  quadratic  beam  addition  (for  example,  in  the  diagram  shown  in  Iigure  ~.lt-i 
the  probability  of  error  can  bt  calculated  from  formula  fn. It  is  somewhat 
greater  than  in  j  Kake  system  (formula  (b.b.'l  . 

Fast  Fading  in  a  Mu  1 1  i  beani  Channel 

All  systems  previously  named  which  are  intended  for  multibeam  channels  j  re 
suppose  rather  slow  fading  in  each  of  the  beams.  luth  fast  lading  when  ^  •  I 

a  multibeam  channel  with  I  i  is  a  Category  M  channel  and  tins  greatly 
hinders  processing  of  the  received  signal.  Ihe  only  system  known  ti  the  author 
which  retains  working  capacity  under  these  conditions  was  first  suggested  in 
19  and  was  named  AM!.  (Ant  i  -Mu  1 1  i  path  I  quipment  l  - -a  device  for  protecting 
against  multibeam  propagation. 
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\  should  he  transmitted  or  tti  it  <yrbi  1  \  ,  should  hr  t  r.msni  t  Its! .  In  the 

*  _  -  »  *  *- 

second  element  use  i  s  nnuii  it'  s  i  ,i  I  s  -  ,it  of  ;  ,  ,|t'  respe  it  no  1  >  ,  etc., 

*  «  -  -  »  - 

until  tr.msciissioii  in  'he  n  ?h  eienent  of  >i>;nal  :  hi  or  :  ,  ( t  '  .  In  the 

I  ,  n  *•  *  n 

'n  *  lj-th  element  again  use  i*  made  of  signals  , (t  I  and  ^Itl  and  then 

the  cycle  r  neats  itself,  Ihe  sequer  re  u!  frequencies  is  shown  in  !  i^ure  I“. 
I  he  spread  between  adjacent  frequencies  must  be  sufficient 1\  great  so  that 
signal  spectra,  with  ,ii  count  t  en  ot  their  widening  due  to  tadiii);,  do  not 
o\  e  r  !  a;  . 

Ihe  number  of  pairs  of  frequencies  n  is  selected  based  on  the  ondition 
nl  I.,  therefore  after  reception  it  a  certain  >•  i  gna  I  ;  ^  f  t  '  this  >  ame  signal 
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r  i  paired  Mfiu)  (■)  ".•»  urr  \<  at  an  input  »n !  \  .11  !cr  tine  I.  »p'c  n  I 

iihi*n  thr  .uriv  M  .•!  .ill  he  an*  !  r«  .»  prcv  i  iu\  1  v  !  signal  ends.  !  1. 1  n 

I  c<r*~it»  ill  'i  rn’in.il  in,;  with  i  riMiu  r  tnli  that  band  »>!  f  rofut  ti  i  a  r  s  ir  wh  i  M  at 
i  giver.  t  t  :u-  thr  arrival  oj  the  r.un  hear.  i  *.  expected,  ax  shtn.r  tor  th<  par 
I  usii.ir  riM'ivrr  xhovn  m  iigurr  “ .  .*0  .  I  hr  he  sr-v  .  urrr  s;  ondj  rij;  to  th<  tran» 

.lit!  c,J  *.  .  gnu  1  »  h.i.r  5  rr.ivir  ru  t  r  x  nut  tailing  t  n  thr  o!  *h<  r<r«i  <i 
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I  i  n  r  a  frcQuCncicv  of  .*  .,  8  r  ot.cn 

I  i  •  •  .  f  r eg uc n c  i  c s  of  . 
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(lue'VCC  o  +  $  v~bo  I  s  V  ^  V  |  .  v  |  ,  v  s  ^  | 

(S'Kidod  Ar.-uv  Sho.s  Receiver  f’.nsv- 
t.vnds)  'So  I  i  d  line,  firs  br.)C  . 

firoVen  |  Inc,  s  ub  <.cqi.cn  t  t ears  . 
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sunring  up  uh.it  ha  K-cr  s.ml  i  :i  this  chajter.  we  rvtr  tli.it  in  principle 
shame!*  with  j  ir.ireters  uhish  change  rapidly  .ms!  depend  on  frequenev  arc  en  - 
tin  Iv  suitable  (Or  transmitting  discrete  messages.  1  urt  hernore  ,  with  the 
so  Fee  ted  signal*  in  the  proper  form  it  ss  pessible  to  get  a  highei  Jvgroe  of 
fidelity  in  such  channels  than  in  channels  with  slow  general  tailing.  iowevor, 
decision  principles  in  many  cases  are  complex  and  difficult  to  implement  ,  es¬ 
pecial!;.  when  it  is  necessary  to  transrit  i n forma t i on  at  a  great  rate,  exceeding 
1/1  . 
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1.  (Vi’  Si\  ?  i  ui!  '.!)  Ihe  construction  of  mode 1  ^  ot  .1  channel  with 
!  rcijuciiv)  -  dependent  \  art  ol*  !c  p.ir  i&et  er->  1  *>  de*»v  r  1  bed  has  1 ..  ad  I  y  mi  ,i.  >  urJ.4iia' 
with  works  |1,  J  J  .  ■>n  1'  1 ,1 !  departure*.  an  due  to  an  effort  to  1 1  ms  l  l  Ik 

i!uk.i»  t «*md  in  [1.  .’)  where  the  authors  r.ai, «„•  tomal  um-  of  .1  lniit  um 

•  1  .if.'  fairs  w*.  h  t#.e»  >. S3 o*i  not  t  o  c  »  1  s  t  Jot  squared  mu nt eg r.»t  ab  l.e  ?  utw  ?  .  n 
irsJ  the*  also,  without  .ssn  qua  1 1 8  1  v  .at  1  n.  use  singular  provisoes  ®i  .1  \  1  n  •> 

!  j "  1 :  t  j  s pi v  t iu~  . 

.  see  "s  1  k  T  t  *  *r*  .f  k<  ;>t  1  si  nt  .1?  i  .>r,  ot  Imuttuii  hu.  mg  .>  -pi.tnr' 
winch  i'  nut  s’tnvtb  1 2  r  1 1  <  -  ii  in  tin  .form  ot  .1  t.ote  lmf  <>t  sene'  ''.lit  <  : 
t  “  ,  S  .*  slwulil  !>e  ions  jifer  «-vl  .is  approx  in  ite  .  1  he  .net'.nii-  mean  -  sqt.i.s  re  eric: 

id,  it  can  be  slot  1  no  J  Ik  .1  traction  0:  the  f  imi’t  ot  the  t  met  1  on  hi  114;  c»|  * 

which  lies  beyond  the  limit*  nt  the  ’’boundary ”  1  rrqueiuy.  J  lie  h  i  g,hc  t  t!i<  •  . 
queue y  selected'  the  mor.,c  r.iptdb  the  spectrum  is  dumped  beyond  its  limits,  u,,. 
the  more  accurate  is  thi*  representation  (see.  tor  example  j.’J.  J.i],  he  w  ,  1  1 
note  that  if  a  signal  spectrum  ilimnishes  with  an  in* lease  in  more  rapt.!)  , 
tha.ci  transfer  function  t  (  1 .  ,  t  1  ,  then  an  appro  u  mate  "boutnlarv"  signal  t  r  1 
quvticy  call  be  used  bar  ,  m  formula  t'.ll  ihe  same  pt  rt  ad  t  in  t  >>r 

~U  la  I  '  .  J  I  . 

5.  (See  Section  ~.ii  I  lie  chamie  1  models  shown  in  'inures  ~ .  J  ar.u  ",  - 
also  encompass  those  casi  s  whet*  a  signal  U-r  its  separate  component  s  1  .no  i.i  1  * 
a  sloppier  frequency  shit:.  It  is  ease  to  see  ,  toi  ivarpli  .  that  it  ,r 

X, 

.1  vOs  X  am!  t  b  sill  t.  then  t  he  altgul  a!  t  t  eqUetlc  I  e  •  >  J  .It  aft  I  ;  . 

signal  will  be  shifted  In  .  i.etieraiii  '(taking,  it'  -i  gn.il  it  1  l-e  '  t) 
j  asses  through  a  fading  ihaimrl  ,  the  signal  at  siaiitul  output  o  equal  t. 

Pr  '[  •  If)  I ».  Pl  '’•*.<  ill  pr  (  ■  (fl  |>  ' '  re  I 

where  .  (tl  defines  a  c  h  <Jtge  in  envelope  and  l(i)  J’-(  Is  the  change  in  phase 

Ihe  JiTiwtiu'  d.  dt  represents  ,1  dapple!  shift  in  frequence  .  In  1  -v  hn  t  i  \  t 

fading  model  nr  a  r.ultibear,  rode!  this  pertains  to  separate  branch'  .  in  a 

channel,  he  will  note  that  it  is  the  deppier  shift  in  t  requenev  ir  *  r -,'t  1 
‘earns  (caused,  for  example.  In  a  shift  m  reflecting  areas  I  which,  t .  r  the  most 
part  determine-  interference  lading. 

•1.  (See  Section  1  i  Ihe  definition  given  he'.'  lor  ('ategors  I  and 

(  ategory  II  channels  is  in  accordance  with  work  [ t> j  and  also  with  a  report 
given  by  I.  Green  at  the  All-Union  Scientific  Session  of  the  Scientiim  and 

technical  Society  0}  Radio  l.ngi  neer  i  tig  and  i  e  lecommun  1  cat  1  oils  named  t  ;  \.  s, 

I'opov  in  1 9 b d .  A  somewhat  different  definition  was  suggested  by  !,  sitorov 
[5]  who  relegates  to  Category  I  those  channels  tn  which  the  pass1'. uni  k  wider 
than  the  total  width  of  the  fluctuation  spectrum  of  transfer  coei'f i ci on’ s  for 
all  beams .  lhese  two  definitions  in  essence  coincide  if  it  is  considered  th  it 
tn  a  channel  a  correction  in  the  phase  -  frequency  characteristic  takes  place, 
since  in  this  case  the  length  of  response  can  be  considered  inversely  propor¬ 
tional  to  the  passband. 
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I  see  Section  ~ .  J  he  will  present  a  proof  to  show  that  anony  constant 
linear  circuits  with,  a  yiven  anp  1  i  t  ude  -  frequency  character!  ^t  ■  c  :(_i.J  a 
circuit  with,  a  linear  phase- frequeno  characteristic  lias  the  least  mean-square 
length  of  response.  I.et  111.)  =  (!(  i exp ( - i : ( .  I  ]  .  The  circuit  impulse  transfer 
function  of  ll(-)  is  a  lourier  transform  of  l!i.)  and  for  physically  realizable 
circuits  III')  equals  zero  when  0.  With  a  physically  realizable  stable  cir¬ 
cuit  :  tj  . )  when  !!(.  )  are  integral  able  when  squared.  The  derivative  d:(.-l/d. 
defines  the  phase  1 ay  of  a  signal  in  the  circuit. 


We  will  introduce  the  following  de  li  ni  t  i  ons  .  We  will  call  the  fellowinj; 
the  average  phase  1  ay 

(  1  («.»)  '■  !,j 


f,r’(«) 


and  the  following  th.e  mean- square  of  the  phase  lay 

f  ^  ;  l«.i  .  , 

r 

\  *  '  f  »  \a 
• 

sinl.uly,  we  will  call  the  ful  lowing  the  average  .croup  lac 

7 

\  [-■)!■. 

X 

"l  '  / 

{ ir  pi 

and  the  fol  lowing  the  mean-suaatv  .o'  t ho  croup  lay. 

'T 

*li  I  * 

[  //‘(.I 


C.tdM 


'OJ 


We  will  first  show  that 


i  1 


lor  this  purpose  we  will  designate 


lie '  lj  •  i  -  a  I  .  and  I  n :  i  i  >  -  -h1  l.  I'hen  ("l.  I  -  a~i.)  *  b“(.i  and  :(.) 
Mu.) 


(w) 


Whence , 


]  b‘  (w  *  i’^l  ..:'(<»»)  Mm) 


'•'M 


l  •  0 


where  the  primes  indicate  derives  witli  respect  5 
Substituting  i.~.7oi  in  (-.('9)  we  obtain 


-•in  - 


J  (6  (to)  ,1  (<jj)  -*d'  (gj'|  6  (to);  r/lO 

r 

^  ( .  "•  (to)  ./to 


n  (to)  J  //  (:)*."  <*» ’  '  *. 
0 
r 

b  ;<•*)  ^  //(•■)  -iii 


i;'  (to)  j  mJI  (")  N»<I 

u 

n 

fc'(to)  ^  t// (•)  1 1 
u 

I'he^efore,  considering  that  a(.)  is  an  oven  am!  b(.)  is  an  odd  faction, 
we  obtain 

-r, 

^  [£>'  (co)  a  (to)  -  -  (<./)  ft  (to)  /<o 

-  -/ 

Cr  or  & 

*  ^  [a  (tii)  |  \fl  \  *.)  i  t.s  a.*../:  •  6(t«i)  ^  *.//(-.)*■  I  «<•>:  /«»> 

-xt-  u 

/•  f 

1  J  '//  l*)  ^(<*>)|  • 

-  5  u 

Subs  t  i  tut  i  ng  this  result  in  ("."'ll  and  changing  the  order  of  integration  (.which 
is  easily  seen  to  be  j  *.*  nni  ss  i  b  1  e )  and  also  considering  that  according  to  the 
IM  an she  re  1  theorem 


we  obtain 


j//:  (.)  '•  j  H 

0  -  V* 

r  r/> 

it  ^  n 

..  “  r 

^  <_  '  (id)  .  Id  J  '  l  • 


(  •  TV 


further,  we  will  find  tin'  dependence  between  and  •  .  Inasmuch  as  ~  1 1  (. '  .1 
is  the  Fourier  transform  of  d:(j.  !/d..  ,  then 

r .  i  n  r .  i  r  .  .  . 


f  ,  1  f  i  *•'>  r ,  if 

..:J|  ....  jil'-K-i  ■ 

VO  f 

■/ 

— /V'  <  xp  |  /?  ('•*)!!"  j-  r'VilV  (Id)|  .Id. 


Substituting  this  expression  in  (7.72)  and  considering  (7.75)  we  obtain 
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'jLjZt i 


S'l  ■  %  ■ 


J  <  . 


ho  del  i  no  t ho  mean-square  length  ot  rosponso  as 


j  l- 

U 

x  * 


17. 7S) 


1 1  can  oas  i  1  v  i  o  soon  that  1. 


I  I  I 


or,  considering  (7.7(<|  and  (".  8  I 


J 

^  <:  ‘  (u> ),/(..  j  [o  (w)  -  oj-w  '((,j),/u 


V  Vi  —77 


j'.'tw). 


— — 

j"  O  (u)  ./w 

—  ■/, 

Iho  second  tore  on  tho  right  sido  is  dotonninod  complotolv  by  tho  given 
amp  1 i tudo- f requency  oharaotori st i c  of  tho  circuit  and  tho  first  to  mi  is  not 
negative.  it  follows  that  I.  roaches  a  minimal  magnitude  when  tho  first  torn) 
is  equal  to  iteru.  lor  this  purpose  it  is  essentia’  that  ••(..)  -  •  -  const., 

i . o .  ,  that  tho  circuit  phase  -  frequency  oharaotori st . c  :(.J  be  linear. 

Similar  relationships  between  instantaneous  signal  frequency  and  its  spec¬ 
tre  m  are  obtained  in  work  [_’•]]  from  which  it  follows  that  with  a  given  envelope 
a  signal  with  a  constant  instantaneous  frequency  has  the  least  spectrum  width. 

(> .  (See  Section  ~.5|  he  will  consider  the  case  of  very  rapid  fading 
( •  ^  €  1)  under  the  assumption  that  the  power  spectrum  of  fluctuat  ions  is 

strictly  limited  and  uniform  in  a  bant!  from  ..  to  _ .  In  this  case  the  corre¬ 
lation  function  is 

‘2  i?7  (7 1  -f,»  • 

inasmuch  as  T  ■■  t  in  equation  (7.55)  the  up|ier  limit  of  the  integral  can  be 

K 

set  equal  to  infinity.  Its  solution  will  be 


i  tin  (c.m-  'J_rL 

T"  {52,1  —  pi  —  I)  r.j 


(VSO) 
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Let  signal  z  (t)  =  a  cos  ..  t  where  ..  ...  ••  J  •  /'!' .  Then  the  filters  in 

r  i-  r  a 

figure  ”.80  have  transfer  functions  equal  with  an  accuracy  to  a  constant  co¬ 
efficient  of 


sln|£y~(/i--J)rJ 

Is*’,'  •"  ("  -  l)nf 


(n</<  rj 


The  transfer  function  of  such  a  filter,  to  a  groat  degree  of  accuracy,  amounts 
to  pi-shaped  function  with  a  passhand  of  2  ,,  an  average  frequency  of  .  , 

and  a  phase  lag  equal  to  (n-1 )"/...  It  can  easily  be  seen  that  in  this  circuit 

at  the  stimulator  output  at  instant  of  readout  will  he  the  sum  ol  the  squares  of 
the  values  of  the  envelope  of  the  received  signal  which  has  passed  through  a 
band  filter  taken  at  a  kotelnihov  interval  of  /  ...  Such  a  circuit  can  he  re- 

placed  with  one  hand  filter  with  a  following  quadratic  detector  by  summing  the 
value  of  the  detected  voltage  using  an  integrator  as  shown  in  ligure  ".9. 
Apparently  such  a  circuit  will  he  close  to  optimal  in  the  case  of  fast  fading 
with  a  varying  fluctuation  spectrum  hut  the  filters  must  he  in  a  certain  sense 
matched  with  this  spectrum. 


(See  Section  7.5)  In  evaluating  system  noise  in  a  widc-band  receiver 
providing  for  discrimination  of  one  beam  or  addition  01  beams,  we  assumed  that 
the  leading  and  lagging  beams  act  on  a  coherent  detector  (multiplier)  or  on  a 
matched  filter  as  gaussian  noise.  Undoubted Iv  this  is  justified  if  randomly 
selected  realizations  of  a  normal  process  in  a  given  frequency  hand  are  used 
as  signals.  A  question  arises  as  to  whether  ;t  is  not  possible  to  especially 
select  an  ensemble  of  signals  so  as  to  decrease  system  noise. 

If  we  are  speaking  of  selection  of  one  realization  of  a  signal  (for 
example,  for  a  system  with  a  passive  interval  or  with  opposed  signals),  then 
for  complete  elimination  of  system  noise  it  should  he  required  that  the  signal 
be  orthogonal  to  its  copy  which  is  shifted  by  any  time  segment.  Inasmuch  as 
this  is  impossible,  usually  we  limit  ourselves  to  the  requirement  that  in  the 
case  of  a  shift  by  any  time  segment  above  a  certain  minimal  value  (on  the 
order  of  1/F)  the  condition  of  orthogonality  he  net  at  least  approximately. 

In  this  case  the  leading  and  lagging  beams  will  act  on  the  decision  circuit 
(matched  in  time  with  the  beam  being  selected)  much  less  than  normal  noise  with 
the  same  power.  Therefore,  the  requirement  is  met  In  signals  which  are  modulated 
in  phase  by  so-called  Barker  codes  (see,  for  example,  [25J)  or  a  pseudo -random 
sequence  of  .pulses  also  called  a  sequence  of  maximum  length  [JO]. 


Kc  can  construct  a  signal  whose  autocorrelation  function  represents  a 
single  peak  of  length  1/F,  i.e.,  provides  for  exact  orthogonality  of  signal 
and  its  copy  shifted  by  any  interval  not  divisible  by  the  period  and  not  ex¬ 
ceeding  l/i;.  For  this  purpose  a  signal  is  modulated  in  a  balanced  modulator 
by  a  special  sequence  of  pulses  with  a  variable  amplitude-  [26).  It  can  easily 
bo  seen  that  the  noise-like  signal  obtained  in  this  process  is  modulated  in  am¬ 
plitude  as  well  as  in  phase. 

Additional  information  about  optimal  reception  of  signals  in  a  channel 
with  randomly  changing  parameters  can  be  found  in  works  [2,  5,  27 1  . 
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CHAPTER  VIII 


CHANNEL  WITH  LUMPED  AND  IMPULSE  I  NTERFERENCE 
8.1.  Definition  and  Basic  Character i s t i cs  of  Lumped  and  Impulse  Interference 

In  communication  channels,  along  with  fluctuation  interference  which  i 
well  approximated  by  gauss i an  noise,  additive  interference  of  another  kind  i  ■- 
often  encountered.  In  radio  channels,  especially  medium  and  short  wave,  a 
dominating  role  is  played  by  lumped  and  impulse  interference,  to  which  this 
chapter  is  devoted. 

Additive  interlerence  in  which  the  main  part  of  the  power  is  concentrated 
in  separate  frequency  bands  less  than  or  comparable  to  1/T,  where  T  is  the 
length  of  a  signal  element,  is  called  lumped  noise.  It  occurs  most  frequently 
in  radio  channels  as  a  result  of  the  action  on  the  receiver  of  signals  belonging 
to  extraneous  communication  channels.  In  this  case  lumped  noise  is  also  called 
mutual . 


Additive  interference  which  differ  from  zero  only  in  separate  time  inter¬ 
vals  differing  greatly  from  T  and  separated  hv  much  longer  intervals  free  from 
interference  is  called  impulse  interference.  Impulse  interference  is  a  regular 
or  random  sequence  of  interfering  impulses.  The  sources  of  impulse  interference 
in  radio  channels  are  extremely  varied.  Included  in  them  are  atmospheric  dis¬ 
charges,  industrial  installations,  ignition  systems  in  internal  combustion  en¬ 
gines,  medical  and  household  instruments  and  appliances,  etc. 

Lumped  and  impulse  interference  are  found  in  other  communication  channels, 
e.g.,  in  cable,  hydroacoustic,  etc.  The  sum  of  monochromatic  interference  with 
random  (.but  not  changing  in  time)  amplitudes,  frequencies,  and  phases  is  an 
idealized  limiting  case  of  lumped  noise.  The  overall  frequency  band  occupied 
by  such  interference  has  a  measure  of  zero  and  therefore  does  not  reduce  the 
carrying  capacity  of  a  channel,  from  this  it  follows  that  in  principle  there 
should  be  methods  of  signal  reception  with  which  idealized  lumped  noise  can  In¬ 
completely  suppressed,  i.e.,  will  not  cause  errors. 

A  sequence  of  del t a- funct ions  occurring  at  random  instants  of  time  wit., 
random  intensities  is  an  idealized  limiting  case  of  impulse  interference .  The 
power  spectrum  of  such  interference  is  unlimited  but  its  total  time  of  exis¬ 
tence  has  the  re as ure  zero.  Consequently,  it  also  does  not  reduce  the  carrying 
capacity  of  a  channel  and  methods  of  reception  must  be  used  which  permit  com¬ 
plete  suppression  of  the  idealized  impulse  interference. 

Actual  components  of  lumped  noise  are  not  precisely  monochromatic  just  as 
actual  impulses  are  not  de 1 t a- funct i ons .  Therefore,  complete  suppression  of 
such  interference  is  impossible  although  it  can  be  partially  suppressed.  We 
will  explain  what  we  mean. 


Lot  thoro  bo  at  a  channel  output  a  signal  and  a  certain  additive,  non- 
gatissian  interference  which  we  will  describe  by  the  average  spectral  power 
density,  he  will  assume  that  the  decision  circuit  is  selected  so  as  to  be 
optimal  for  gaussian  interference.  The  probability  of  error  in  this  case 
will  be,  depending  on  the  nature  of  the  interference,  either  greater  or 
smaller  than  in  the  case  of  gaussian  interference  with  the  same  spectral 
density.  However,  in  many  cases,  as  will  be  shown  below,  it  differs  little 
from  the  probability  of  error  in  the  case  of  gaussian  interference.  If  it  is 
possible  to  select  signals  and  construct  a  decision  circuit  such  that  the  pro¬ 
bability  of  incorrect  reception  of  a  signal  element  of  finite  length  T  with 
given  interference  will  be  as  small  as  desired,  we  will  say  that  the  inter¬ 
ference  is  completely  suppressed.  If  the  probability  of  error  remains  finite 
but  much  less  than  in  the  case  of  gaussian  interference  with  the  same  spectral 
density,  we  will  say  that  the  interference  is  partially  suppressed. 

Unfortunately,  for  all  practical  purposes  there  does  not  exist  at  the 
present  time  a  general  thcon  for  optimal  reception  in  the  case  of  non-gauss i an 
interference.  \rriving  at  such  a  theory  entails  great  difficulty  inasmuch  as 
such  interference  cannot  be  completely  described  by  the  fir..t  two  moments, 
furthermore,  even  a  un i d i mens i on a  1  probability  distribution  of  non-gaussian 
interference  is  not  invariant  with  respect  to  linear  conversions. 

fhe  problems  involved  in  selecting  an  optimal  signal  system  and  decision 
circuit  for  a  given  interference  structure  have  been  considered  theoretically 
only  for  a  few  particular  cases  in  which  additional  simplifying  assumptions 
are  made.  Included  in  such  particu’ar  cases  are  idealized  lumped  or  impulse 
i nterference .  Investigating  channels  m  which  lumped,  impulse,  and  fluctuation 
interference  is  simultaneously  present  entails  tremendous  difficulty. 

It  many  works  (.for  exampli  [!,  dj).  the  effects  of  lumped  and  impulse  in¬ 
terference  on  a  decision  circuit  optimal  for  the  case  of  gaussian  interference 
have  been  studied  i  r.  detail  and  the  probabilities  of  occurring  errors  have  been 
calculated.  The  solutions  to  such  problems  are  rather  trivial  and  their  prac¬ 
tical  importance  is  limited  to  those  channels  in  which  the  intensity  of  impulse 
or  lumped  interference  is  small  in  comparison  with  the  intensity  of  fluctuation 
interference.  In  the  interest  of  economy  of  space,  we  will  not  discuss  these 
problems  (set1  Note  1  to  this  chapter). 

Many  methods  of  suppressing  lumped  and  impulse  interference  have  been 
developed  based  on  intuitive  ideas.  At  the  present  time  the  theory  behind 
this  problem  ,tt  best  explains  the  essence  of  the  methods  used  and  serves  to 
explain  several  details. 

Wc  will  note  that  methods  permitting  good  suppression  of  lumped  interference 
usually  worsen  conditions  for  suppressing  impulse  interference  and  vice  versa, 
lhis  will  he  shown  below  based  on  several  examples.  furthermore,  all  methods 
lead  to  a  situation  wherein  the  decision  circuit,  is  not  optimal  for  fluctuation 
i nterference . 
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Radio  channels  in  the  long,  medium,  and  short  iv.iu-  ranges  aro  alw.ns 
subject  tu  the  action  at’  a  great  deal  ot'  lumped  nuisc.  Ibis  is  the  coiim 
quonce  of  the  radio  wave  propagat  1  on  conditions  in  these  ranges  uhiv.li  result 
in  the  generation  of  a  perceptible  potential  field  at  considerable  distance 
from  the  transmitter  at  every  emission.  lhe  majority  of  tins  noise  is  ot 
relatively  low  strength,  but  the  addition  ol  them  all  together  forms  tin 
general  background  noise  which  is  little  different  in  its  charm  t  e  r  i  s  t  i  c  •-  1 1  o" 
normal  white  noise.  Of  this  sort  of  noise,  all  the  findings  u!  the  pien-dinv 
chapters  from  the  study  ot'  fluctuation  noise  are  true,  but  this  noise  1 '■  in  t 
the  subject  of  the  present  chapter,  he  will  here  be  interested  in  the  nidi 
vidual  lumped  noise  which  stands  out  against  the  common  hacl.giound  noise  and 
is  commensurate  in  power  with  the  useful  signal.  Ihis  noise  is  eiicount  e  i  ed 
in  all  ranges,  and  during  the  planning  of  systems  and  equipment  toi  i.uliv  wi' 
muni  cat  ion  the  possibility  of  it  is  always  taken  into  cons i derat i on . 

With  respect  to  the  mechanism  ol  its  action  on  signal  rece|tioii  It  imp  id 
noise  may  be  divided  into  three  types: 

aj  noise  whose  spectrum  is  concentrated  m  a  f requeue'  band  complete!'  >  i 
partially  coinciding  with  that  occupies  by  the  signal, 

h)  noise  whose  spectrum  lies  outside  of  the  signal  t requeue)  band  (often 
called  "mli  acent  -  channel  "  i  nt  erferer.ee  i  ;  and 

c.)  noise  which  at  t  h  -  input  ot  the  recei’.ii.g  unit  ha  a  pect  run  wh.vi.  In 
outside  the  signal  frequency  bam!,  hut  which,  because  ot  nonlinear  voniero  >n 
in  the  receiving  device,  form  components  which  fall  in  :*><•  -are  :  rv-.  atm  1  at.  : 
as  the  s  j  gnu  1  . 

Reducing  the  chances  hr  such  nonlinear  noise  et'tect  n  oru  ot  tie  '.vs;, 
problems  in  developing  radio  receiving  devices.  It  is  sf  l.e.l  in  h  '  id  n 
all  manuals  on  radio  reci  i  v  i  tig  equipment  ,  we  will  theta  t  rv  tent:  an  n  ,  ’  >  T  .  ■ 
to  the  degree  that  it  is  associated  with  introducing  spec  .  a  I  m  In, ear  •  li’V'.t 
into  the  receiver  :  iron  it  to  pro’ect  against  other  types  ot'  noise. 

The  rapid  development  of  radio  common i. at i ons ,  as  well  e-  . '  t  other  ap;  .  . 
cations  of  radio-elect  rom  cs  ,  has  brought  .limit  a  situation  wiierein  rad  i  :  t  i  - 
quency  bands  are  overloaded  with,  different  emissions.  lhe  result  i  ■-  that 
mutual  interference  in  many  cases  predominates  over  all  other  ta.f or-  in  ios 
tricting  the  real  carrying  capacity  of  radio  channels. 

The  fundamental  methods  of  protection  against  lumped  noise  which  have  ivv 
applied  from  the  very  beginning  of  radio  communication  right  up  to  the  present 
timi  are  based  on  frequency  selectivity.  Spatial  seiecliv  tv  which  is  also 
widely  used  is  provided  by  directional  transmitting  and  receiving  antennas. 
Although  it  was  shown  as  early  as  the  liJaU’s  that  frequency  and  spatial  selec 
tivity  was  by  no  means  the  sole  method  for  discriminating  a  useful  signal  fro:- 
noise  [3],  lhe  first  attempts  to  put  other  methods  into  practice  are  found 
only  very  recently. 

frequency  selectivitv  for  the  purpose  of  eliminating  mutual  interference 
presupposes  a  certain  regulation  of  the  frequencies  set  aside  tor  various 
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I  hus  .  it  wc  assume  that 


where  z  It  I  is  one  signal  elemi-nt. 
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are  known, 


dee  i  s  i  on  principle  (,  S  .  S  I  is  realized  hi  e  lenient -by -e  lemeiit  reception.  Ill 
actuality  it  is  iicccssan  to  analyze  an  arriiiiijt  signal  over  the  interval  til 
in  order  to  vie  term  me  I  here  fore,  the  subopt imal  decision  system  consists 

o!  two  part''.  In  the  first  part  the  received  signal  '  ( t  )  is  analyzed  over 
length  of  time  il,  \alnes  if  are  determined,  and  a  "eorr'Cted"  signal  (t  ) 

is  form  vd .  In  the  'eioml  part  principle  |S.yi  i  ■-  realised  and  the  rece  i  veil 
.■vie  vyrl'id.*.  i  re  determined  in  turn.  I  lu  s  part  coincides  completely  with  the 
ili  ;  i  n  iiicuit  used  i  i  t  luc  t  u  at  i  on  i  nt  e  rference  ,  the  only  dilterence  heiitjt 
tv  t  ;  list ,.i  ot  w.r  i  •.  ed  •- 1  f.na  1  /  ’  1  t  i  ,  t  is  delivered  to  the  input  Illume 
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s\-ter  ceinciiles  with  that  obtarned  in 

interference  with  a  nonuni  form  spectrum , 
c  but  i  .in  for  different  subscripts  k. 

shown  m  lif.ire  s  _  j  15  for  .»eak  signals, 
be  >con  that  it  amounts  te  the  circuit  for 

er  111  (s.-)  . 


In  the  general  ease  the  components  of  lumped  noise  have  a  distribution 

differing  from  normal  and  therefore  the  coefficients  of  ,,  depend  on 
■>■>**  k 

C“  =  A“  +  B“.  In  many  radio  channels,  according  to  observations,  the  distri- 
K  K  K 

but  ion  of  probabilities  of  the  square  of  the  amplitude  r  of  lumped  noise  is 
close  to  normal  - logari thmi c : 


C'/,  f  v  1 

V  -/> 


US.  10) 


where  i.  is  the  median  value  of  and  .•  is  the  mean-square  deviation  of  In 

K  K 

I'lie  dimei.si  uiless  magnitude  .  ,  depending  on  the  load  of  the  band  and  other 
actual  conditions,  lies  within  limits  from  2  to  !>.  In  til  i  s  case, 


i 


(X.  1  1  j 


Considering  that  in  C“/ ^  lias  a  normal  distribution  with  a  zero  mathema¬ 
tical  expectation  and  a  dispersion  of  •  ,  it  can  be  asserted  that,  with  a  pro¬ 
bability  of  the  order  of  0.", 


therefore,  with  sufficiently  large  .  in  the  first  approximation 

U  >  '  ■  (S. 11a) 

'  * 

In  this  case  can  be  found  within  a  priori  knowledge  of  the  median 
values  of  .  the  signal  (t)  formed  in  this  case  has  an  amplitude  of  spec- 

K 

tral  components  inversely  proportional  to  the  amplitudes  of  correspond i ng  com¬ 
ponents  of  signals  z'(t). 

We  will  not  try  to  compute  the  probability  of  error  in  the  circuits  consi¬ 
dered  inasmuch  as  this  entails  a  great  deal  of  difficulty.  Bv  way  of  indirect 
evaluation  of  the  degree  of  suppression  of  lumped  noise,  wc  will  determine 
the  gain  in  the  ratio  between  signal  power  and  average  spectral  interference 
density  when  a'(t)  becomes  r(t).  This  gain  is  sufficiently  well  characterized 
by  the  increase  in  resistance  to  interference  in  changing  from  a  kotelnikov 
receiver  circuit  which  is  optimal  in  the  ease  of  white  gaussian  noise  to  a 
circuit  which  is  optimal  or  subopt imal  in  the  case  of  lumped  noise.  We  will 
limit  ourselves  to  the  subopt imal  circuit  shown  in  figure  S.2. 

The  strength  of  useful  signal  contained  in  z'(t)  is  equal  to 


-426- 


The  number  of  terms  in 


I'he  strength  of  the  noise  in  r'(t)  is  equal  to  '  7, 

k 

these  sums  is  equal  to  nl-’T  where  l;  is  the  conditional  frequency  band  occupied 
by  the-  signal.  The  ratio  between  the  power  of  signal  element  and  the  average 
spectral  density  of  the  interference  is  equal  to 

V  rk,r 


After  transforming  the  signal  received  into  (t)  in  accordance  with  (8.7a), 

the  strength  of  the  signal  proves  equal  to  ~T V]  K  and  interference  strength 

l  \A  * 

is  equal  to  '■<  7j  t,  '*  .  Therefore  the  ratio  between  signal  element  strength  and 

k 

average  spectral  interference  density  in  ' ( t )  will  be  equal  to 
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V  <1; 


(S. 17) 


The  gain  in  such  a  transformation  is  equal  to 


v 
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Vq  V  -t; 


(8.14) 


If  nTT  -  1  (signal  AT  or  IT  in  analysis  of  interference  over  only  one 
signal  clement),  then 


i.e.,  there  will  be  no  suppression  of  interference. 

We  will  consider  another  extreme  case  when  nIT  ••  1.  Dividing  the  numerator 
and  denominator  of  (S.  14)  bv  (nTT)-  and  using  a  wavy  line  to  indicate  averaging 
over  all  frequency  components,  wc  obtain 


Vi-ti 


(8. IS) 


With  an  increase  in  NTT  the  average  values  in  the  numerator  and  denomina¬ 
tor  of  (8..15)  approacli  in  probability  corresponding  mathematical  expectations 
so  that  whc”  nTT  •  1 
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Assuming,  as  formerly,  that  C“  •••':  ^  C“  ,  it  is  |)ossible  to  consider 

and  c~  as  independent  variables,  consequently. 
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In  that  ease  when  has  a  normal- logari thmi c  distribution  (8.10)  and  all 

i,  arc  the  same,  and  the  values  of  .  are  determined  from  the  approximate  for- 
k  k 

mula  (8.11a),  it  is  easy  to  calculate 
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and,  finally, 
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(8 


With,  values  of  .•  ranging  from  J  to  -1  the  gain  C  fluctuates  within  limits 
2  1  1 

(I  o*10  --8*10  “ .  This  means  that  even  a  suboptima]  system  suppresses  lumped 
noise  almost  completely  if  nIT  is  sufficiently  large. 

The  magnitude  of  n  is  determined  by  the  interval  of  time  over  which  the 
strengths  of  the  components  of  lumped  noise  can  be  considered  constant  and  is 
usually  small.  Therefore,  to  realize  the  possibility  of  sufficiently  effective 
suppression  of  lumped  noise,  wideband  dense  signals  with  a  large  base  IT 
should  be  used.  These  can  be  impulse  signals  differing  from  zero  only  for  a 
small  part  of  the  length  of  element  T  or  the  noise- like  signals  [5j  which  w.re 
mentioned  in  Chapter  VII.  Sometimes  it  is  convenient  to  shape  a  wide-hand 
signal  from  a  simple  narrow-band  signal  using  frequency  diversity. 

In  the  latter  case  another  method  of  reception  based  on  the  selection  of 
that  diversity  branch  in  which  the  lumped  noise  has  the  least  strength  is  pos¬ 
sible.  It  is  simpler  although  further  removed  from  optimal.  This  means  that 
in  reception  principle  (8,5)  the  values  of  .  arc  not  determined  from  formulas 
(8.11)  but  arc  considered  equal  to  unity  for  that  component  for  which  the  lumped 
noise  is  minimal  and  zero  for  all  remaining  components. 

In  work  [4]  this  method  is  considered  for  that  case  when  the  signal  and 
the  lumped  noise  are  subjected  to  Rayleigh  fading  and  this  describes  the  situa¬ 
tion  in  shortwave  radio  channels  rather  woli  This  means  that  the  amplitude 
of  of  the  lumped  noise  component  has  a  conditional  distribution  density  of 


“■((if,  > 


where  is  a  random  variable  conforming  to  the  distribution  shown  in  (S.1U). 

It  can  bo  shown  that  oven  in  this  situation  it  is  possible  to  obtain  quite 
significant  suppression  of  lumped  noise. 

8.3-  Mutual  Interference  and  Frequency  band  Occupied  by  a  Signal 

In  the  preceding  section  we  showed  that  in  a  channel  with  narrow-band 
lumped  noise  it  is  advisable  to  use  wide -band  signals.  As  long  as  wide-hand 
si. Minis  are  used  only  in  exceptional  cases,  they  indeed  permit  obtaining  a 
,:e  power  gain  with  respect  to  lumped  noise.  If  wide-hand  radio  communica- 
t.  i  systems  come  into  wide  use,  the  picture  will  change  greatly  inasmuch  as 
;  t  . a  1  interference  will  no  longer  he  narrow-band  and  the  Statistics  will  varv 
r.  leitly  from  the  picture  presented  above. 

We  will  assume  th.it  the  load  of  a  hand,  i.e.,  the  number  of  transmitters 
o] crating  simultaneously,  does  not  change.  Then  in  the  transition  from  narrow- 
band  signals  to  wideband  signals  the  average  number  of  sources  determining 
the  interference  component  in  (w.i)  will  increase  by  as  many  times-  as  did  the 
base  ot  the  signals.  With  an  increase  in  the  base  the  probability  density  of 
l  its  t  ant. moons  values  of  the  components  of  mutual  interference  will  approach 
normal.  therefore,  the  optimal  decision  system  will  approach  a  Kotelnikuv 
system  and  there  will  no  suppression  of  interference.  A  question  arises  as 
to  whether  it  is  j  cssible  to  decrease  mutual  interference  by  proper  selection 
el  the  signal  base. 

lor  the  more  than  lui  1  f -century  ot  existence  of  radiu  conununi  cat  i  on  the 
conviction  has  reigned  that  the  uni’,  way  t e  reduce  muiial  interference  lies  in 
reducing  the  frequency  band  assigned  to  each  radio  channel.  Indeed,  the 
narrower  this  1 requency  band,  the  mor.  such  bands  can  be  designated  in  a  giver 
range  for  various  channels,  thereby  providing  for  absence  of  mutual  interference 
in  the  passha.nd.  I.ven  m  the  case  of  i incomplete  regulation  of  frequencies, 
the  reduction  in  assigned  bn:  d  i  r.  reducing  a  receiver's  passband  reduces  the 
probability  of  random  t  nt  e  i  (V  min  enter,ng  this  band. 

Ihe  development  of  common i cat i on  equipment  has  been  guided  in  large  measure 
by  this  idea.  In  the  area  ol  •  r.insmi  1 1  i  ng  discrete  messages  over  radio  channels 
( radi otc I egraphy  the  transition  fror  spark  transmitters  which  emitted  damping 
oscillations  with  a  wide  nowe:  q  -ct rum  to  arc  transmitters  and  then  to  tube- 
type  transmitters  of  "non-damping"  oscillations  permitted  a  large  increase  in 
the  number  of  "operating  frequencies"  in  a  given  range.  Until  approximately 
the  1950's  the  frequency  band  assigned  to  a  radio  channel  was  determined  mainly 
by  frequency  instability.  !he  shortage  of  free  frequency  bands  which  grew 
worse  with  every  passing  yv  n  ("crowded  ether")  was  the  principal  stimulus  in 
developing  equipment  with  greater  frequency  precision  and  stability  and  this, 
unquestionably,  was  a  jrogrcssivi  trend,  frequency  precision  increases  by 
approximately  one  order  over  a  period  of  ten  years.  At  the  present  time  in 
most  cases  the  required  mmim.il  receiver  passband  (at  least  in  the  range  of 
radio  frequencies  to  20-JA  m  on. I  with  I  <  JO-JA  msec)  is  determined  not  by 


frequency  imprecision  but  by  the  width  of  the  signal  power  spectrum  which, 
in  turn,  depends  on  the  base. 


The  effort  to  reduce  the  receiver  passband  has  led  to  a  tendency  to  de¬ 
crease  the  signal  base.  The  single-channel  systems  of  voice-frequency  tele¬ 
graphy  in  which  signals  were  segments  of  a  modulated  harmonic  oscillation, 
the  base  of  which  was  much  greater  than  unity,  formerly  in  wide  use  have  almost 
completely  disappeared.  In  TK  systems  the  difference  in  signal  frequencies 
has  gradually  been  reduced  and  at  the  present  time  in  some  systems  has  reached 
1/T.  In  a  binary  system  this  corresponds  to  IT  =  2.  finally,  during  the  past 
few  years  K PM  systems  with  IT  =  1  have  been  introduced. 

However,  as  has  been  stated  many  times,  the  conditional  frequency  band  I 
and  the  width  of  the  power  spectrum  have  different  meanings.  A  receiver 
passband  cannot  be  reduced  to  f  since  the  transient  processes  in  a  filter 
cause  an  impermissible  increase  in  the  probability  of  error.  In  the  effective 
width  of  a  power  spectTum  of  a  signal  and,  consequently,  the  required  re¬ 
ceiver  passband  is  much  wider  than  the  hand  of  frequencies  1 ,  dividing  a  range 
;unong  radio  channels  proves  to  be  uneconomical. 

for  a  more  economical  use  of  a  frequency  range,  it  is  desirable  to  use 
those  signals  the  power  of  which  is  concentrated  as  well  as  nossible  within  the 
limits  of  frequency  band  f.  Hut  for  this  the  signal  base  must  be  great  (see 
Note  4  to  Chapter  111.). 

for  purposes  of  explanation  we  will  assume  that  in  a  certain  band  l  ,  N 
transmitters  are  operating  and  II  ••  1.  for  simplification  we  will  assume  that 
messages  are  encoded  in  a  binur>  code  and  each  of  the  transmitters  uses  a  pair 
of  rrthogonal  or  opposed  signals  but  that  these  pairs  are  selected  random  I \  for 
eu.h  channel.1  A  useful  signal  for  which  the  decision  system  of  a  receiver  is 
calculated  arrives  at  the  input  of  any  of  the  channels  being  considered  along 
with  interference  which  is  the  sum  of  N  -  1  signals  of  the  remaining  channels 
using  the  given  frequency  band.1  With  a  sufficiently  large  N  this  interference 
can  be  considered  normal  fluctuating  interference,  especially  in  that  case 
when  wide-hand  signals  have  a  uniform  spectrum  in  band  f,  i.e.,  are  noise-like. 


‘If  all  signals  of  the  channels  using  the  frequency  band  were  selected  from  one 
set  of  mutually  orthogonal  signals,  each  of  them  could  be  separated  with  a 
filter  matched  with  it  and  mutual  interference  would  be  absent  as  in  the  case 
of  an  orthogonal  separation  multiplexing  system  (see  Chapter  IX).  However,  thi 
is  unrealizable  if  signals  arc  emitted  by  different  transmitters  and  arrive  at 
the  input  of  a  transmitter  with  different  delays  since  the  orthogonality  of 
the  signals,  generally  speaking,  is  disrupted  when  one  is  shifted  in  time  with 
respect  to  another. 

•Since  when  IT  "  1  the  share  of  signal  power  outside  the  band  is  small,  the  re¬ 
ceiver  passband  can  be  only  a  little  wider  than  !•  and  this  permits  ignoring 
the  interference  lying  outside  the  frequency  band.  It  is  possible  to  also 
ignore  interference  caused  by  spurious  emissions  in  comparison  with  the  inter¬ 
ference  created  by  the  principal  emission  of  the  transmitters,  especially  if  \ 
is  large. 


The  spectral  density  of  lumped  noise  in  this  case  is 


\  i 


■  i 


(  S  .  1  8  ) 


where  I',  is  the  power  of  the  i-th  interfering  signal  and  I' ^  is  the  average 
signal  power. 

Ihe  ratio  between  the  power  of  the  useful  signal  and  the  total  spectral 
density  of  interference  which  determines  the  probability  of  error  is  equal  to 
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In  "overloaded"  radio  frequency  ranges  the  spectral  density  of  fluctuation 
interference  I, mainly  receiver  set  noise  and  some  atmospheric  noisei  ^  can  be 

ignored  in  comparison  with  . .  In  this  case 


<<  . 


If  h~  is  known  based  on  obtaining  a  required  level  of  fidelity, 


(S. 1 9  a  J 
then 


t.e.,  the  pennissible  number  of  simultaneously  operating  independent  channels 
in  frequency  band  I  is  approximately  proportional  to  the  signal  base.  In  this 
case  the  permissible  range  load  density,  i.e.,  the  number  of  channels  per  unit 
of  frequency  band  (when  N  1'  is 

\  /•  l  , 

,  /••-..  (8.:0a) 

a 

does  not  depend  on  1  in  the  fi  r.  t  apptvx imat i on. 

separating  the  required  sjgjvii  from  a  large  number  of  interfering  signals 
with  commensurate  power  is  done  in  using  matched  filters  or  other  circuits 
similar  to  the  wav  in  which  beams  are  separated  in  the  reception  of  wide-hand 
signals  in  a  channel  with,  mult  i  -beam  propagation  (Chapter  VII).  Specifically, 
in  a  system  with  matched  filters  the  useful  signal  creates  sharp  peaks  in  the 
envelope  while  all  remaining  signals  with  which  the  filter  \<  not  matched 
create  only  background  noise. 

he  will  note  that  the  ratios  obtained  remain  valid  if  among  the  N  inter¬ 
fering  -ignal:  ther-'  are  narrow -band  signals,  as  long  as  they  are  uniformly 
distributed  in  frequency  band  f .  On  the  other  hand,  as  already  noted,  wide¬ 
band  signals  do  not  represent  for  narrow-band  systems  significantly  greater 
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i n to r to rence  than  do  narrow-hand  signals  tor  the  same  spectral  density.  This 
can  easily  he  understood  since  only  a  very  small  share  of  the  power  of  a  wide¬ 
band  signal  enters  the  receiver  passhand  of  a  narrow-hand  signal.  Therefore, 
it  can  be  asserted  that  wide-hand  and  narrow-band  communication  systems  cannot 
be  considered  incompatible. 

iVe  will  present  the  following  numerical  example  to  demonstrate  the  for¬ 
mulas  obtained. 

1  -  1 
l.ot  h"  =  20  (which  provides  for  a  probability  ot  error  less  than  10  >n 

the  case  of  incoherent  reception  in  the  absence  of  fading  or  with  quasi  - 

Rayleigh  fading  if  the  share  of  the  regular  component  is  sufficiently  gret), 

i 

f  =  10  “  sec.  f  -  in’’  civs,  and  ['•-!’  .  In  this  case  the  signal  base  B  -  2 FI  : 

1  s  av 

=  2000.  from  (S.20)  it  follows  that  in  this  frequency  band  signals  from  N  el 
transmitters  can  be  transmitted  simultaneously. 

This  number  can  be  increased  if  power  l\  of  the  useful  signal  at  the  input 

of  the  receiver  is  greater  than  the  average  power  P  ^  of  the  interfering  signal. 

Ihis  in  practice  is  almost  always  tae  case  if  only  because  in  the  selection  of 
frequencies  conditions  of  radio  wave  propagation  are  considered  and  optima  are 
obtained  for  a  given  disposition  of  transmitter  and  receiver,  lurthermore, 
even  when  using  antennas  with  a  small  directivity  factor,  it  is  always  possible 
to  achieve  an  advantage  for  useful  signal  in  each  channel.  \ssuming  that 
P  -  2P  ,  we  obtain  \  51  1 00  and  this  gives  a  density  of  range  load  on  the 

order  of  one  channel  per  kilocycle. 

This  coincides  approximately  with  the  load  density  when  using  narrow-band 
signals,  for  example,  I'M,  in  the  case  of  regulated  frequency  distribution. 
Indeed,  the  minimal  frequency  band  1  occupied  by  a  binary  IM  signal  is  equal 
to  2/1,  or  when  T  =  10*-  sec  to  1  -  200  cps .  But  the  receiver  passhand,  as  we 
have  seen,  must  be  much  wider  in  order  to  avoid  errors  from  transient  processes 
and  constitutes  a  minimum  of  o()0-oOP  cps.  If  we  consider  the  required  "pro¬ 
tective"  band,  which  we  discussed  earlier,  it  appears  that  the  range  load  den¬ 
sity  is  greater  than  one  channel  by  a  kilocycle  when  T  *  10‘-  sec  is  not 
provided  with  an  I'M  system.  Of  course,  it  is  possible  to  increase  the  load 
density  in  the  case  of  a  regulated  distribution  ot'  narrow-band  signals  by 
using  not  l-.M  but  PM  or  KPM  which  cuts  i  in  half.  However,  in  the  case  of 
narrow-band  signals  there  are  additional  reserves  for  increasing  the  range  load 
ilcns  i  ty . 

*> 

One  such  reserve  is  reduction  of  the  permissible  magnitude  of  h“.  This  can 
be  achieved  by  using  diversity  reception  and  in  channels  with  multibeam  pro¬ 
pagation  the  method  of  adding  beams  described  in  Chaptei  VII.  It  is  also 
possible  to  reduce  the  permissible  value  of  ;v  by  using  correcting  codes,  cs - 
pecially  in  feedback  systems  (see  Chapter  X 1 l . • 

‘We  will  not  consider  increasing  the  range  load  density  by  lengthening  a  signal 
element  here  because  increasing  I  reduces  the  rate  of  information  transmission. 
The  number  of  channels  in  a  given  frequency  band  is  proportional  to  T  not 
only  for  wide-hand  but  also  for  narrow-hand  signals. 


The  number  of  channels  using  ;i  given  frequency  band  can  be  greatly  in 
creased  if  it  is  considered  that  not  all  channels  operate  simultaneously. 

We  will  use  a  to  indicate  the  probability  that  a  certain  channel  is  operating 
(.for  simplicity  we  will  consider  this  probability  the  same  for  all  channel''!. 

We  will  stipulate  that  h  must  lie  not  less  than  a  permissible  value,  say,  a 
probability  of  0.99.  Ibis  means  that  with  a  probability  of  0.99  the  number  o! 
simultaneously  operating  channels  must  not  exceed  \  in  formula  (S.JO).  lu 
using  n  to  denote  the  number  of  operating  channels  and  N  the  total  number  of 

channels  using  a  given  frequency  band,  it  »s  possible  to  find  the  p:obabilit> 
of  obtaining  a  magnitude  for  n  which  is  determined  In  the  binomial  distribution: 

/'(")  Cn  j"(I  -j)v*  ", 

and  the  probability  that  n  will  not  exceed  the  permissible  value  of 
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n  1 

for  large  it  is  possible  to  replace  the  binomial  distribution  with  a 
normal  distribution  and  consider  as  approximately  correct. 
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Assuming  this  probability  to  be  equal  to  0.99  and  considering  that  0.99  =* 
(J.bJ,  it  is  easy  to  obtain: 


A  U.OKA.Ml  M  i  aA.. 


hence  for  given  a  and  X  it  is  easy  to  find  N  .  lor  example,  with  >  -  1 / J  and 
X  =  100  the  number  of  channels  can  be  =  1~0.  With  an  increase  in  N  (for 
example,  by  increasing  the  base)  the  N  /\  ratio  increases  and  tends  toward  1/.. 

In  the  case  of  a  regulated  distribution  of  frequency  bands  among  narrow- 
band  channels  it  is  impossible  to  use  non -simultaneous  operation  of  them  in 
order  to  increase  the  range  load  density.  Indeed,  if  one  frequency  band  is 
assigned  to  channels  and  their  transmitters  create  powers  of  the  same  order 
at  the  input  of  the  receivers,  when  they  uie  operating  simultaneously  with  a 
probability  of  j‘  ,  communication  will  be  disrupted  in  both  channels. 

In  work  [6]  there  is  a  comparison  of  narrow-band  and  wide-hand  signals  from 
the  point  of  view  of  mutual  interference  in  the  case  of  unregulated  band  dis¬ 
tribution.  The  author  of  this  work  gives  preference  to  wide-hand  signals.  The 
essence  of  his  argumentation  amounts  to  the  following,  lor  a  given  range  load 
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and  given  signal  powers  t h«-  .i\ «- r spwtr.il  Ji'iiMlt  of  lumped  noise  is  th« 

•..inn-  for  narrow -band  or  wideband  signals.  but  in  a  I  requeru*  ban.l  of  a  narrow - 
band  sicful  the  spectral  Jensitv  o’  i  nterteretice  fluvtuates  within  wide  I, Pits 
while  in  a  frequence  band  of  a  wi*J.  band  m^iuI  it  changes  little.  therefore, 
in  tlic  ij’ii1  of  w idr-bai.il  ^  i  »:n a  1  -  a  larger  range  toad  »h.in  iri  T It*  case  of 
narrow -band  signals  is  permissible  in  obtaining  a  guaranteed  high  probability 
ol  sat  i  s  t'a«  ’  orv  contain  I  cat  i  .  •  .  In  other  worJs,  .1  w'dehand  system  provides 
tor  satis*.Ktorv  vomrum  vat  ion  with  sn.ilt  I  luctu.it  i  <n*>  in  the  prohatilitv  of 
err*  r  while  m  tin-  cast  of  a  narrow  -band  system  under  the  sari  venditions 
commit  n  1  e.it  1  on  will  some  tines  be  excellent  and  sWrl  iMts  unsat  1  s  t  a.  t  orv  . 


It  would  hardly  be  u'i  rei't  to  assume  that  in  the  ease  of’  wide -hand 
systems  it  is  possible  to  retrain  completely  from  regulation  of  frequencies. 
However,  regulation  tor  wide -band  signals  under  certain  conditions  is  easier 
and  need  not  be  too  rigid  ami  deviation  iron  regulated  use  of  frequencies 
leads  to  consequences  not  as  severe  as  m  the  case  of  narrow-band  signals. 

8 . h .  Mathematical  Description  of  Impulse  Interference 


lor  anilysis  of  conditions  for  signal  reception  in  the  case  of  ir.jmlsi 
interference  we  will  represent  an  interfering  irpulse  n^,t)  in  the  form  of  .1 

lourier  series  over  an  interval  of  time  equal  to  the  length  t  an  element  cf 
.1  signal  being  received: 

nr 
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where 
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In  essence  senes  is.p.ti  repiesent*  not  .1  single  impulse  ti  (  t  !  but  .1 

periodic  sequence  of  such  impulses  with  a  period  of  I.  Put  inasmuch  as  we  a*e 
studying  e  lenient -bv-e  lerent  rece|ti*.'n,  v>e  are  interestev!  in  the  behavior  ot 
such  a  signal  as  well  as  the  interference  over  the  interval  (0,  II.  It  is 
also  possible  to  view  ( s .  M  as  an  expansion  of  a  single  impulse  into  a 
series  with  respect  to  segments  of  a  sinusoid  and  a  cosinusoid. .  If  function 

n  (t  1  expresses  the  realization  of  a  random  impulse  then  ^  and  ^  in  (  S  .  J.v ) 

ire  realizations  of  certain  -andotr,  values. 


lor  realization  of  in  idealized  i~pils( 


ri,  >n 


l.M 1  f,  I 


(•‘.Ml 


(where  t  ^  is  the  moment  of  occurrence  of  the  impulse  (0  t(  1 

efficient  the  physical  essence  of  which  will  be  explained  below) 
coefficients  ^  ,  ,-j  i  r.  (S.J.si  van  easily  be  determined  using  the 

expanding  a  function  into  a  lourier  series: 


and  A  is  a  co- 

the  values  of 
usual  rule  for 
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We  util  kOtiMilfr  the  v. tints  ol  \  and  ;  to  be  random.  and  t  nd-petuhn:  . 

t 

We  util  note  th.it  in  distinction  t  ro~  tin-  .'as.  ol  white  not  so  the  too! 
ficieiits  of  th*  1 1  u:  lei  -frit-s  .mJ  are  not  independent.  Ind»ed.  bv 

1.  nou  i  ng  .in-  two  of  the-f  t  oe  l  f  i  c  t  out  •>  :t  ;s  possible  to  mi. mb  t  guous  1  -  Jet-r- 
mune  the  magnitudes  o:  \  and  t  arid  in  ac  cordan-e  with,  ther  regene  late  the 

t.iliif-  ut  .ill  renaming  oitlt  i-ifti:-.  '-fu-rthf  h-- ,  .»1!  I  mirier  to  tficients 
are  pairwise  not  correlated  .is  Unit;  .is  the  nagnitude  ol  t  ^  with  e»|iial  proba¬ 
bility  adopts  any  value  in  the  interval  l'  t  I.  IV.  i  s  can  e.»s:l-  he  seen 

by  computing.  the  ~athen.it  i  k  a  1  expectation  >>  -he  pro-lu-t  ot  am  pair  o!  >.  o  - 

effuients.  [or  example,  for  ,  and  ■,  .  t  •  .  /  >  ,  ,  we  have 

i  1  L  .  1 


/.  '■  ‘  “l"f1 


l.  -i’  ■ 


r r ;  t.j. 
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whence  it  follows  that  i,  and  .  ,  are  rot  lortei.iteil.  Die  -ar.i  result  an  be 

1  i  m 

obtained  for  any  j.nr  1  coefficients  and  and  also  lor  am  pair  ol  co¬ 
efficients  ;  with  different  suV-cr  pts. 

I  he  r.at  henat  i  c  a  1  expectation  el  ,  and  ,  with  a  uniform  distribution  ot 

>  » 

t  and  any  distribution  o!  probabilities  cl  »  m  eu.al  to  ;cro.  I  he  dispersion 
of  each  of  the  coefficients  ot  a  lourier  se.ies  is 


\  =  ,  t'"'1 


Ke  will  set  2  (A*-)  /T  .  Hy  analog  with  ( 5  .  1  b  '  it  is  possible  to  -St  fine 

the  physical  meaning  of  ^  as  the  spectral  densitv  ot  an  interfering  impulse. 

In  distinction  from  the  case  of  white  noise  the  magnitude  -t  m  not  constant 

i 

but  asstaBes  different  values  (or  different  elements  of  the  signal.  wpec l f l . a  1  1  \ 
it  is  equal  to  zero  if  over  the  length  of  a  given  element  interfering  impulses 
Jo  not  arrive  at  the  receiver  input.  When  there  i-  a  -uflu  lcnth  strong 


i  tile  r  I  e  r  i  U£  impulse,  .i-  .1  rule.  the  r..i,;r.  i  tin'-  el  ^  ;  riuo  t  u  !  e  ru.  h 

th.ui  the  vpvcJr.il  JeriM  t »  o  i  t  luctu.it  ion  inti  rlc  n  m.r  .uni  itjujIm-  mtt 
..111  tor  .ill  pr.ictic.il  I'lirjMM"  .  or.p  lete  !  >  destroy  the  1  nt  <  rr.ut  1  on  cunt 

1  1  \  eti  s  1  i;n  .1 1  el  •T.en  t  . 
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figure  8.3-  Interfering  Impulse. 

\clu.il  1  nt  e  rt  or  1  11  ^  ir.pulsos  h.ne  .1  tiniti  length.  let  .11  impulse 
ctfhed  by  .1  cert.iin  function  1  I  i^ure  s .  3 
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wlure  depicts  the  shape  ut  the  pulse  .uni  when  v  I  J  I  1 

v.t  ol't.itn  .in  expression  tor  the  I  'iirtor  .  .>ef  f  1 . 1  ents 
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Indeed,  lor  example.  lot  i  .mil  -  bo  known.  Sir  will  show  th.it  tin*-  pel 
nits  ft  ml  i  it);  loci  1  i  it  out  s  j  and  ^  approx  mate  ly 
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Iron  equations  IS.  31)  and  IS.3J),  know  t  ng  and  .  ,  it  is  possible  to  find 

approximately  ^  and  .  l  in  the  ease  ot'  an  unknown  irpulse  shape  ind  instant 
of  arrival  t  and  the  precision  of  the  result  will  he  greater,  the  less  is  the 

i 

I  rat  i  o  . 

l\c  will  examine  the  case  when  n  s  mlej  emient  randor  interfering  impulses 
represented  by  a  de 1 t a- funct i on  arrive  at  a  receiver  input  during  the  length  ol 
a  signal  element. 

Ihen  the  impulse  interference  is 


n  (n 
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where  t  is  the  t  ns !  .ml  of  occurrence  cl  the  m-th  impulse,  and  -’O')  I  is  its 
a  '  n 

spectral  donsity. 

In  this  i  .iso ,  .is  o.i  n  easilv  be  soon. 


*  I 


If  n  is  suffi  o  i  ont  lv  large  and  \  aro  random  valuos  having  a  limited  dis- 

n 

pcrsion,  then  accordi ng  to  the  oontral  limit  theorem  and  ^  li.no  an  approx i- 

r.ately  normal  probability  distribution,  t  >  :  s  i  do  r  i  ng  that  they  furthermore  aro 
not  mutually  correlated,  it  oan  bo  concludt  .  that  with  a  large  number  of  im¬ 
pulses  in  interval  I  tlu  impulse  nterten-  o  differs  little  from  normal 
white  noise  .is  was  discussed  above.  lliis  ..ine  result  can  be  generalised  to 
apply  to  the  casv-  of  impulses  of  finite  !o:.,;th,  the  only  ditfereme  being  that 
the  noise  funned  b>  such  impulses  is  not  white  since  its  spectral  density 
at  high  frequencies  diminishes  faster,  tlu  longer  the  length  of  the  impulses. 

lo  describe  the  lourier  coe  f  f  i  ;  i  ent  s  ot  impulse  interfennco  lormed  t. 
chaoticalh  occurring  impulses,  it  is  further  essential  to  note  that  and  ^ 

are  not  correlated  with  one  another  t  r  differint  elements  of  a  reconed  signal, 
lliis  obviouslv  fo!  lows  from  the  f..t  that  ..iM<>us  impulses  which  ire  not  in¬ 
dependent  on  one  another  tale  part  in  the  formation  of  these  coe ff i c i ent s  . 

8.5  Possibilities  i  n  Principle  of  Surpressincj  Impulse  Interference 

Ihe  rigid  functional  dependent'  between  coefficients  and  ot  impulse 

interfcrenc  yields  the  possibilitv  o’  constructing  a  foe. si  on  system  ot  a 
receiving  device  in  which  the  presence  of  impulse  interferon'*0  does  not  increase 
or  increases  almost  not  at  all  the  probabihtv  ot  i-  errea  signal  reception. 

In  the  idealized  .aso,  when  the  impulses  an  represorted  b>  de 1 1 a - func t i ons  , 
it  is  possible  to  achieve  complete  suppnssion  ot  impulse  interference.  In  the 
case  of  actual  impulses  of  finite  length  the  interference  can  be  suppressed 
almost  completely  as  long  as  ■*  1  ir-J  during  tlu  time  of  r-oept  i  on  of  one 
signal  clement  the  number  of  interfering  impulses  is  rather  sn.i]]. 

let  a  signal  occupying  frequency  band  !  and  impulse  interference  arrive  it 
the  input  of  a  receiving  device  (ligure  S.Jj.  IV e  will  not  it  first  consider 
the  effects  on  reception  of  the  inev  itable  fluctuation  1  nt crfcienci  .  Ivc  will 
send  the  received  signal  with  the  interference  to  i*u  multipliers  to  which  art 
applied  reference  voltages  cos  I'.^t  and  sin  k’.pt  where  f '  is  ,i  whole  number 
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such  that  the 
example,  it  is 
k  '  =  k  ,  ♦  1  . 

1 0 ,  I)  and  the 
ted  to  a  speci 


frequency  v» !  k*.  lies  outside  the  signal  t  re  q  lie  net  hand.  I  or 
(>os>  i  h  i  e  to  choose  k'  k^  -  I  or,  as  was  doin  in  I  i  gure  S .  1 , 

I  he  multiplier  output  \  ullages  .ne  integrated  over  the  interval 
resultant  ly  denveJ  voltages  proportional  to  ,  and  .  are 
al  circuit  which  omputes  the  v..lue  ot‘  \  and  t  .  Ihese  data  per- 

i 


nit  the  i  ntert'efetue  impulse  to  he  regenerated  il  it  sufficiently  accurately 
approximates  a  de 1 1 a- tune t i on .  Inasmuch  as  i  use  1  is  spent  on  integral i on 
the  regenerated  impulse  is  delayed  h\  that  time  in  comparison  with  the  impulse 
which  entered  the  input  ot'  the  ivot  i  i  c  nut.  It  the  incoming  signal  p  passed 
through  a  delay  line  ot'  time  I  and  the  icgi  in  rat  isl  impulse  is  subtracted  from 
it,  we  may,  in  principle,  obtain  a  s  l  nr.  tl  free  ot'  impulse  noise. 


I  he  given  circti  t  is,  of  course,  very  complex  for  practical  realization 
and  is  regarded  i  e  only  as  a  demoii't  ;  ,.t  iot  of  the  possibility,  m  principle, 
of  suppressing  impulse  noise  m  the  >:a  ■  of  lUeal  do  1 1  a  - 1  i-vpi:  1  ses  . 
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figure  8 .  *« .  Diagram  Illustrating  the  Possibility  in 
Principle  of  Compensating  for  Impulse  Interference. 


Practicable  methods  ot  >.  <nplete  r  almost  complete  suppress?  ot;  of  impulse 
noise  will  be  examined  below,  but  I  efor-  proceeding  tc  a  description  of  them, 
it  is  useful  to  elucidate  from  the  ■  xa  pie  of  the  idealized  ciicunt  in 
ligurc  S.l  certain  general  patterns  w  ,  ch  character  i  ze  all  suet,  methods. 

Let  us  begin  with  a  consideration  it  the  defects  of  this  network  and  of  the 
fundamental  possibilities  ot  eliminating  then. 

lirst  of  ,11,  let  us  remark  that  the  circuit  ot  I  igure  s.-l  provides  for 
compensation  ot  the  interference  impulse  only  in  case  it  is  the  only  one 
throughout  the  length  of  the  signal  element.  Ihis  drawback  may  be  to  a  con¬ 
siderable  degree  eliminated  by  complicating  the  circuit.  One  possibility  is 
that  instead  of  expanding  the  sigp.il  plus  noise  into  a  lourier  series  over  an 
interval  of  duration  1  it  be  expanded  ever  interval  I  n ,  where  n  i <  some  whole 
number.  Here  in  contrast  to  the  circuit  of  figure  S.-l  the  reference  voltage 
must  hi  e  a  frequency  divisible  not  by  ,  but  by  n.^.  and,  as  before,  lie 

outside  the  signal  frequency  band;  and  integration  must  be  performed  over  time 
I/r,  while  tin  delay  line  must  be  adjusted  ft  r  th«  same  period.  Under  this 
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condition  all  the  interference  impulses  may  be  compensated  if  there  is  no  more 
than  a  single  impulse  in  each  T/n  interval. 

Another  possibility  for  suppressing  n  interference  impulses  randomly 
scattered  throughout  the  signal  element  length  is  to  use  n  pairs  of  reference 
voltages  of  cos  k'..^t  and  sin  kV^t  with  different  values  of  k'  and  frequencies 

lying  outside  the  signal  frequency  band.  This  permits  us  to  determine  2n 
values  of  i^,,  •  ,  which  may  be  substituted  in  (8.54)  to  compute  the  2 n 

unknown  A  and  t  .  The  computation  can  in  principle  be  done  electronically 

and  the  compensation  accomplished  as  in  Figure  8.J. 


Both  of  these  methods  permit  the  compensation  of  no  more  than  a  certain 
number  n  of  the  interference  impulses  for  which  the  circuit  is  designed.  It  is 
obvious  that  forming  a  system  capable  of  compensating  any  arbitrarily  large 
number  of  impulses  is  fundamental  1 v  impossible  because  as  n  grows  larger  the 
impulse  noise  approximates  normal  wnite  noise. 


Let  us  return  to  the  system  in  Figure  S.4  which  is  designed  to  compensate 
individual  interference  impulses  and  take  into  consideration  the  effect  of 
the  inevitable  fluctuation  noise.  Its  action,  as  is  easy  to  see,  shows  itself 
in  the  fact  that  it  is  not  the  Fourier  coefficients  ^  ,  and  ,  of  the  inter¬ 


ference  impulse,  but  the  sums 
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t 

accurately  computed  and  the  interference  impulse  will  not  be  fully  compensated. 
Furthermore,  if  throughout  a  given  signal  element  an  interference  impulse  Joes 
not  proceed  to  receiver  input  th<’  compensating  impulse  will  nevertheless  be 
formed  under  the  effect  of  the  corresponding  component  of  the  fluctuation 
noise  and  will  be  added  (with  sign  reversed)  to  the  signal.  Since  the  Fourier 
coefficients  of  the  white  noise  are  mutually  independent  this  will  not  result 
in  compensation  of  the  noise,  but,  on  the  contrary,  will  increase  its  spectral 
dens i tv . 


It  may  therefore  be  said  that  the  system  of  Figure  8.4  by  compensating  for 
impulse  noise  intensifies,  as  it  were,  the  strength  of  the  fluctuation  noise. 
This  increase  in  spectral  fluctuation-noise  density  is  ordinarily,  however, 
not  great  in  comparison  with 

i  . 

In  urucr  to  lessen  this  deficiency  we  may  have  recourse  to  a  more  complex 
system  and  employ  a  certain  number  r  of  units  which  compute  the  parameters 
\  and  t.  and  which  use  different  frequencies  K’^q.  Averaging  the  values  ob¬ 
tained  for  these  parameters  we  may  increase  the  accuracy  with  which  the  com¬ 
pensating  impulse  is  shaped  and  reduce  the  increase  in  fluctuation  noise 
intensity  to  a  negligible  value.  If  in  sc  doing  it  must  be  possible  to  com¬ 
pensate  n  impulses,  then  nr  pairs  of  reference  voltages,  2nr  multipliers  and 
integrators,  arid  r  circuits  for  computing  the  parameters  A^.t^m  =  l,...,n) 

with  subsequent  averaging  over  all  r  circuits  will  be  required. 
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The  re fore  impulse  noise  compensation  is  the  more  effective,  the  broader 
the  frequency  band  which  is  used  to  analyze  the  oscillations  at  receiver  input. 

'5 his  conclusion,  as  we  shall  see  from  the  following  examples,  is  common  to  all 
known  methods  of  suppressing  impulse  noise.  The  reason  for  this  may  be  cited 
as  the  fact  that  the  fundamental  difference  between  the  series  of  expression 
(S.25)  and  the  similar  series  for  fluctuation  noise  is  the  rigid  connection 
between  the  coefficients  ^  and  . .  By  exploiting  this  connection  (which 

manifest?  itself  in  particular  as  the  short  duration  of  the  interfering  impulsej 
we  may  by  some  method  detect,  analyze,  and  eliminate  impulse  noise.  It  is 
natural  that  it  is  possible  to  do  this  the  more  easily  and  completely,  the 
greater  the  numbei  of  Fourier  coefficients  and  .  ^  that  are  subjected  to 

analysis,  i.e.,  the  br>'ude»*  the  frequency  band  that  is  taken  into  consideration 
in  the  reception  process. 

Wo  would  remark  that  the  foregoing  is  valid  only  while  there  is  no  lumped 
noise  in  the  expanded  frequency  hand.  Otherwise  the  components  of  the  lumped 
noise  will  be  added  to  the  coefficients  ,  and  ^  ,  used  to  compute  parameters 

A  and  t. ,  and  the  compensating  impulse  will  prove  to  be  sharply  distorted.  The 

result  will  be  that,  instead  of  the  impulse  noise  being  compensated,  the  error 
probability  will  rise  under  the  effect  of  lumped  noise  lying  outside  the  fre- 
qtu  ::  y  band  occupied  by  the  signal. 

from  this  it  follows  that  measures  to  suppress  impulse  noise  may  increase 
tlv  effect  of  lumped  noise  lying  outside  the  signal  frequency  band.  'Ibis  draw¬ 
back  manifests  itself  t"  some  degree  in  all  methods  of  impulse  noise  suppression. 
It.  cannot  usually  be  completely  eliminated,  and  therefore  when  a  receiver  circuit 
is  being  designed  compromise  solutions  must  be  adopted  in  which  the  impulse 
noise  is  not  completely  suppressed,  but  is  so  to  a  significant  degree,  while 
the  lumped  noise  affects  reception  but  little  more  than  in  a  system  designed 
witn  ik  regard  to  impulse  noise. 

Let  us  turn  our  attention  to  still  another  important  feature  of  the  net- 

word.  in  figure  S.l,  namely,  the  nonlinear  device  for  computing  parameters  A 

and  r . .  This  device  must  be  nonlinear,  as  ensues  from  the  nonlinear  nature  of 
1 

(S.2bj  or  (S..vlj  with  respect  to  these  parameters.  The  need  for  a  nonlinear 
device  follows  also  from  the  fact  that  the  Fourier  coefficients  of  the  impulse 
noise  are  mutually  uncorrelated  and  are  consequently  not  linked  to  each  other 
by  any  1  i ne a r  re  1  a t i onsh i p 


Under  actual  conditions  interfering  impulses  are  not  delta- functions. 
Usually  they  uni  be  considered  the  result  of  passage  of  a  delta-function 
Mi  rough  a  linear  circuit  ["|.  In  the  general  case  non-gauss i an  interference 
can  be  described  if,  for  any  k,  k-dimensional  distribution  functions  are  given. 
However,  the  task  can  be  simplified  when  the  impulse  nature  of  the  interference 
is  retained.  Let  there  be  a  certain  number  n  such  that  the  length  of  an  inter¬ 
fering  impulse  exceeds  T/n  practically  not  at  all,  where  I  as  formerly  is 
the  length  of  a  signal  element.,  •  If  n  is  sufficiently  great,  analysis  of  an 

This  requirement  is  essence  means  that  during  time  T/n  an  interfering  impulse 
is  damped  su  much  that  what  is  left  can  he  ignored  in  comparison  with  the  in¬ 
evitable  fluctuation  interference  present. 


element  ot'  an  arriving  signal  van  m  the  I  list  .ippiu'irai  i  a  It  n 

placed  by  an  analysis  of  its  readout  values  at  discrete  inst.mt-  el  tira 
at  intervals  of  1  a.  Hie  values  of  interterenci  it  these  joints  ,  ,(r  h,  ..or. 
sidered  independent  and,  therefore,  for  finding  a  lilelihoeJ  '  uiu  t  i  >t  .md 
constructing  a  decision  principle  it  is  sufficient  to  l.nov.  the  iiiiiJi'  i  :im  a, 
distribution  of  interference  prohub i 1 i t \ .  Ibis  is  done  11  work  [v|. 
contents  of  which  are  reflected  brittle  in  what  toliows. 


let  the  uni di mens i ona 1  probability  distribution  dm-  itv  ot  i  n  t  <  r  !  -  n  : 
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of  ti  mt-  rfiTftu-i  uni  ot:  ts  ,  ■;  \  atu!  .«  drprnd  on  its  intrnsity. 

tlii  v.isf  thv  fhar.iv  :  •  rt  *1.'  f  nor.l  :  near  quadripolr  in  the  circuit 
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In  the  particular  case  when  distribution  (  S  .  IOi  becomes  normal. 

I  h  i  .s  t  Acs  place  when  impulse*  pas*  through  a  na  rrow -ha  ml  filter  aiul  follow 
one  anotlu  r  so  rapidly  that  the  reaction*  they  cause  completely  oveilap. 

In  this  case,  as  shouhl  he  expected,  the  nonlinear  quatlrapole  shown  m 
li^ure  S.o  hecor.es  Inn  .r.  1  urthermoiv .  alJ  the  remaining  quadrapo  1  e*  in 

t  .^ure  S , ,  except  for  t!ie  fir*t,  are  oft  *ince  fror  s.olM  when  *  1 

we  ha\e  v  0.  Ihu*  ,  the  opt  iral  .ieci*.  n  s\  *ter  hecon.e*  a  Koteliiifoi  *v*ter  . 


Figure  £.6.  Subopt  ir.ji  D*'  c  >  ■  :  o*'  System  for 
Receiving  Bin,ir>  Si  geo1  ir  a  CHnnnj>|  v.  i  t  h 
impulse  I  ■' t  e  r  »  e  r,.pCe  , 

In  the  oihei  «  xttvr.  -  i*e  .  t  m-  o  >  rl.ippirc  arum;  ft  a !  *e*  I  J  am! 

the  .  h  a  r.u  t  e  r  i  *  t  i .  ot’  T  h  *  •  qua  'r.i[  u  *!•..-»>■,  in  •  i  ,;ur.  v.t  will  he  expressed  h\ 
x  t  v  .  Wlvn  t  \t  ■  >’  t.i:  i  .;u.id:  .p.  »  i  t !  i  c!i  a  r.u  t  e  r  i  *  t  1  ot' 

>  a  .!>  >; t .  x„  i  . e.,  m  idea!  1 1 r 1 1 •  •  - 

Vs  shown  in  !*j,  t  lie  sub.ipr  i  -.1 1  ,.xtrr  *l  .vi  ; .  i  cure  '.<x  perrit*  sj,;- 
mils  .an  t  suppress  i  on  ot  impulse  i  nt  e  rfer<  r  e .  Ihi*  suppet  sm.ii  :s  greater  , 
f  he  less  .  i  , .  When  I  .!  r;'u  i  -  e  ir.ti  licni.e  i  c.  np ie’e J \  suppressed . 

£.6,  Practical  Methods  of  Protecting  •'»q.«i,*st  Impulse  I  •'  ter  f«»?  crce 

In  radio  vOT.ur.  i  at  :<-n  pra-  1 .  .  e  .,r ;  on*  «>  te-.s  per-:  1 1  jn>.  impulse  inter 
fere nee  suppression  to  one  decree  of  im’her  .» rc  u*ed ,  1  roc.  whet  h.,*  beefi 

*a:d  above  it  i  s  clear  that  such  *v  *  ter-  sh  sil.l  -out  tin  a  non  1 1  neat  element 
m  a  wide 'hand  rec-  ivi  channel,  i.e.,  sr  t'roitt  oi  filter*  rat  i  lied  with  v*r 
signal  at  lea*t  m  pa**hand.  ten.-  wit’’  i  Ji-ut.r  liyure  which  ire 

often  called  KIN  system*  ( w i de - bar d  -  1 ; r i t er  narrow-band  .  sucee-fou  tor  the 
first  time  apparently  i  n  worl  j  i  1  ]  ,  V,  p.  <•  found  widest  use.  If  i  limt-'r  is 
ideal,  t.e.,  the  lii'tnic  threshold  i  *  :<  ro ,  then  *uch  a  sv<te-  coincides  will. 

I'i  Ktire  s.b  when  1.  in  the  case  ».  m!  ■  -  1 1  limiter,  if  the  1  in  t  in; 

threshold'  is  higher  than  the  rn.i'  imur  if  the  *ur  of  the  signal  .uni  the  non 
impulse  interference,  the  revr'\>  r  ope  r  t in  a  linear  re  pi  me  a'li  tie-  tine 
with  the  exception  of  riie  time  ne<  d< d  for  pa-s.u;e  of  tin  interfering  pulse 
(lipuro  S.8)  .  This  creates  more  f  moral  lo  cum!  i  t  i  nil*  fer  protection  .ipui  ri-t  non 
impulse  (for  example,  Tunned)  nt :  r!  orem*- . 
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figure  8.7-  System  for  Protecting  Against 
Impulse  Noise  by  Limi'inq. 


let  us  examine  the  action  of  t 
frequency  character!  >t  i  c  el'  the  1 1  n 
Kill  assume  that  the  impulse  Jurat  I 
than  1  f,  where  ' f  is  the  effect i\ 
assumption  is  usually  fulfilled  in 
input  of  the  limiter  is  a  pood  appi 
linear  circuit.  If  the  signal  plus  •! 
limitmp  level  m  excess  ot  the  max 


system  ot'  lipu:v  s.~  with  npard  to  tin 
ir  section  ot  the  leceivmp  unit.  W- 
at  receiver  input  is  subsl.mt  i  a  I  lv  le-s 
passliaiul  ot'  the  linear  tiact.  I  h  i  ■- 
ictice.  I  hen  the  impulse’  shape  at  the 
u  mat  ion  of  pul’c  response  pit  ot  the 
le  noise  is  ted  to  a  limiter  with  a 


urn  overshoot  ot'  the  sum  ot  the  signal 
I  lus  all  nun- impulse  noise,  the  recti  ver  will  niert  into  a  non- line  ir  repime 
only  throughout  time  that  the  inti  r'Vrence  impulse  exists. 
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Figu'e  8.8.  Limiting  Impulse  Noise. 


Impulse  length  at  lmiter  input-  is  determined  by  the  impulse  response 
yt  f  t  J  or  the  frequency  churucteri  st  ic  o*  tin  linear  channel.  It  is  known  that 
in  minimum-phase  circuits  impulse  letipth  is  approximately  inversely  proper 
tional  to  f.  It  may  as  a  t,rst  approx  iriat  i  on  be  considered  to.at 


l 

J; 


(s.  i:» 


Impulse  response  p(tj  may,  generally  speaf  i  up ,  extend  to  infinity.  1  here  fore 
wt  will  understand  •  to  mean  the  duration  of  impulse  p(t.l  until  the  moment  that 
it  becomes  essentially  less  than  the  sun  of  the  sipnal  and  the  fluctuation 
noise.  We  will  need  only  an  approximation  of  ,  therefore  the  indefiniteness 
l s  not  s l pn i f i cant . 


io  yet  art  approximate  estimate  of’  the  if  foot  of  impulse  noise  it  :n,i>  be 
assumed  that  the  s  i  jtna  1  plus  non-impulse  noise  go  to  the  input  of  the  division 
system  behind  the  limiter,  while  »'e  interference  impulses  are  converted  into 
square -wave  pulses  of  area 
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which  :n  the  first  approx  irnat  i  on  does  not  depi  nd  on  the  ana  of  the  original 
impulse.  I'he  spectral  density  of  the  inteiferencc  impuMo  after  being  inited 
in  accord  with  expression  (  S .  Jt>  is 
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If  the  level  of  limitation  is  fixed,  then  by  increasing  f  we  voitld  oitain 

an  arbitrarily  >  all  va-lue  of  ".  ,  but  as  f  crows  larger  the  levc  cl  t fu¬ 

ll  m 

fluctuation  and  lumped  noise  at  limiter  input  increases.  In  order  for  the  re¬ 
ceiver  to  operate  linearly  when  there  is  no  interference  noise  the  limit  mu; 

level  U ,  must  also  be  raised  with  the  increase  in  passbaiul  f  and  1 ept  above 
lam  1 

the  maximum  overshoot  of  the  sum  of  the  signal  and  all  non-impulse  noise. 


Let  us  designate  the  total  power  of  the  fluctuation  and  lumped  noise  acting 
on  the  limiter  input  by  I*  and  the  signal  power  by  I’  .  I  hen  the  maxinun  over¬ 
shoot  ol'  the  total  signal  and  non- impulse  ’'oi  se  voltage  is  Ml’  »  I’  ,  where  k 

is  the  peak  factor  of  the  total  voltage,  i.e.,  the  ratio  of  the  maximum  i peak ) 
voltage  to  the  mean-square  voltage.'  Having  selected  a  limiting  level  equal  to 
this  maximum  overshoot  we  obtain 


r 

t ,  /.■(/’.  ;  /■  i  i-  v  j  •  .  (s..i;u 

in-  -  1  i  v  /  /  1 

where  ~  =  1’  t  is  the  total  density  of  fluctuation  and  lumped  noise  and 

'  a 

h~  -  IM  .“  is  the  ratio  between  the  signal  element  power  and  the  spectral  den¬ 
sity  of  the  Tluctuution  and  lumped  noise. 

I  he  magnitude  k  may  be  considered  as  the  relative  limiting  level. 


‘Strictly  speaking,  the  voltage  of  normal  fluctuation  noise  has  no  maximum 
value  since  with  a  probability  other  than  zero  it  may  exceed  any  given  value. 
I'herefore,  instead  of  the  peak  value  the  quasi -peak  value  should  be  examined, 
i.e.,  the  voltage  value  which  may  be  exceeded  with  a  probability  no  greater 
than  some  •  .  In  normal  fluctuation  noise  when  •  =  0.01  the  peak  factor  is 
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iho  spectral  density  ol  the  1  at  e 1  for  once  impulse  i  s  ,  ac  cord  i  np  to  expres¬ 
sion  (.S.-14) 
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Ibis  correction  obviously  introduces  no  qual  i  tat  ive  changes  in  the  results 
oh  t  a i fed  which  substantiate  the  possi hi  life  that  impulse  noise  may  he  suppressed 
\ev ortho  less ,  it  shows  that  the  spectral  density  of  the  limited  impulse  noise 

J  may  be  several  times  increased  if  the  area  of  the  initial  impulse  increases 
s.i\,  several  thousand  ttr.es. 

1.  (.See  Section  s..'i  When  selecting  a  limiting  level  we  may  sot  out’selvcs 
a  permissible  probabiht>  that  during  the  period  of  reception  of  a  single 
element  the  envelope  of  the  total  voltage  of  the  signal  and  non-impulse  noise 
will  exceed  tite  limiting  level.  Ue  will  consider  tills  total  voltage  'o  hact 
normal  probability  distribution.  !  In-  average  number  ot’  envelope  overshoots  per 
unit  of  time  depends  on  the  average  width  of  the  spectrum.  In  the  case  of  a 
gauss i art  frequency  rharuet eri st i c  the  probability  .  that  during  reception  of 
a  single  signal  element  the  envelope  of  the  total  voltage  will  he  k  times  more 
than  its  mean -square  value  is  approx  i  mat  e  i  v  [I.sj 


Getting  0.1,  v% «.  find  that  when  ’’I  It’d  it  is  necessary  to  choose  a 
relative  limiting  level  i  •=  ;.s,  itnl  when  fl  -  1000.  a  limiting  level  k  ^  1 . o . 
It'  we  set  .  d.Ol,  tin’ll  wln.’ti  fl  100  the  relative  limiting  level  k  '  1.0, 
uni  when  fl  -  1 U00 .  t  h  i  -  level  ;s  k  =  Ihese  values  of  k  must  he  used  in 

t"  o  r~.ii  las  fs  .  in')  -  s  .  -1“  . 

Ihe  dependence  of  k  on  fl  somewhat  miiibits  increasing  the  suppression 
of  impulse  noise  whin  expanding  tin'  passhand  f  before  the  limiter.  'ov.rthe- 
less,  choice  of  i  sufficiently  1  irge  f  can  •  i mu  1 1 aneous ly  provide  an  arbi¬ 
trarily  snail  probability  of  conversion  to  a  until  inoir  regime  and  an  arbi¬ 
trarily  sr  1 1  1  spectral  dens j tv  of  limited  impulse  noise 

a.  (See  Section  S.“j  Protection  against  lumped  and  impulse  interference 
is  greatly  simplified  in  feedback  systems  which  will  be  discussed  in  Chapter  XI 
Specs  fical  ly.  in  radio  com.run  i  c;.  t  i  on  when  it  is  possible  to  tune  a  receiver 
an!  transmitter  to  any  carrier  frequency  within  a  certain  band,  the  existence 
of  i  feedback  channel  permits  selecting  an  optimal  carrier  in  the  vicinity  of 
which  the  strength  of  the  lumped  noise  at  a  given  time  is  minimal.  The  selec¬ 
tion  of  the  carrier  and  suitable  tuning  can  be  uromated 

Such  a  selecti  in  ot  an  optimal  carrier  frequency  can  be  viewed  as  an 
approximation  to  selection  of  an  optimal  signal  when  the  interference  has  a 
nonuniform  spectrum  'see  Section  3.t>i.  Indeed,  if  the  entire  accessible  range 
of  frequencies  is  viewed  as  a  commun i cat i on  channel  with  l nt erference ,  the 
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selection  of  tin*  0pL1m.il  signal  in  t ho-  first  approximation  amounts  to  concen- 
t  rat  ion  of  its  strength  in  that  frequency  sector  where  th.e  intensity  of  the 
interference  is  minimal. 

The  same  channel  with  feedback  can  be  used  for  interrogating  message 
sections  the  reception  of  which  has  been  disrupted  by  impulse  interference. 
The  detection  of  impulse  interference  can  he  done  as  shown  in  figure  8.10. 
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CHAPTER  IX 

MULTIPLEX  I  MG  COMMUM 1  CAT  I  ON  CHANNELS 
9.1.  Matching  Channel  Carrying  Capacity  with  Source  Productivity 

In  this  chapter  we  will  consider  several  problems  in  matching  message 
sources  with  a  channel.  As  shown  in  Chapter  !,  it  is  possible  to  transmit 
with  a  high  degree  of  fidelity  messages  from  a  source  at  a  fixed  rate  when 
the  carrying  capacity  of  the  channel  ('  (exceeds  the  productivity  of  the  source 
II'.  The  greater  the  d/ll'  ratio,  the  simpler  coding  is  at  a  given  level  of 
fidelity.  If  the  productivity  of  a  source  is  given,  by  selecting  a  channel  with 
a  carrying  capacity  if  t  II',  t  is  possible  to  simplify  the  receiving  and 
transmitting  devices,  but  cost  <,f  a  channel  will  be  very  high  inasmuch  as,  as  a 
rule,  it  increases  mount  on i on  1  1 y  with  the  increase  in  carrying  capacity  and 
range  of  common i cat i on .  If,  on  the  other  hand,  an  inexpensive  channel  witn  a 
carrying  capacity  only  slightly  exceeding  the  productivity  of  the  source  is 
selected,  the  devices  used  for  encoding  and  decoding  become  more  expensive.* 
ubvioush,  generally  speaking,  there*  must  be  a  ratio  between  carrying  capacity 
and  source  p  rewluot  i  v  i  t  y  at  which  the  total  cost  e»  f  a  common  i  cat  i  on  system  is 
a  minimum.  This  optimal  ratio  depends  on  the  level  of  technologic.-!  1  develop¬ 
ment  and,  apparently,  shows  ,1  temlonvy  te>  lessen  |I|. 

If  the  product  i  v  i  t  y  of  a  source*  is  much  le**-  than  the  earrving  capacity 
eif  a  chanin* '  ,  the.*  requ  i  reit.cn  t  s  for  economy  require*  seeking  ways  te>  improve  use 
eil'  a  ch..nncl.  for  this  purpose  ,1  channel  mu !  t  i  p  lexeel .  that  is,  it  is  useel  l\>r 
simultaneous  transmission  of  messages  from  several  source’s  which  are*  i  n  t  e*  neletl , 
generally  speaking,  for  different  recipients.  The  number  of  source's  is  called 
the  multiplicity  factor  of  multiplexing. 

file  oppeis  i  te*  ce  1 . 1 1  i  tie'll  mav  exist  when  tin*  productivity  of  a  source  is 
givitor  than  the*  carrying  capacity  of  the  channel.  in  this  case*  use  can  be 
made  of  two  or  i:n*re*  channel*'.  for  transmitting  a  single*  message*,  i.e*.,  n*s<'rt 
is  had  to  concent  r.  •  t  1  on  of  channels.  if  these  channels  are  i  ndepeadi'nt  , 
their  carrying,  capacities  an*  aikh*d. 

In  tin*  most  general  ease*  n  channels  may  be  used  for  transmitting  messages 
from  cl  i  f  fere'ii  t  m  source's.  I  tins  concent  rat  i  mi  ami  mu  1 1  i  p  lex  i  ng  of  ch.mm  Is  nay 
( ccur  concurrently. 


'Here  encoding  ami  decoding 
a  message'  into  a  signal  and 


arc  understood  in  the  broad  sense  as 
■  once*  rs  i  mi  of  a  removed  signal  into 


IV 


com  e  r*.  i  mi  1  1 
a  message. 


Capable1  combination  of  the  methods  of  multiplexing  and  concentrating 
channels  in  designing  coiiununi  cat  i  on  systems  permits  the  most  effective  use 
of  channel  carrying  capacity,  i.c.,  providing  for  a  high  rate  of  information 
transmission  with  a  given  permissible  probability  of  error.  Unfortunately, 
in  many  existing  communication  systems  channel  carrying  capacity  is  greatly 
under-used.  for  example,  in  cable  communication  lines  the  power  of  a  signal 
element  often  exceeds  the  spectral  density  of  additive  fluctuation  interference 
by  many  more  times  than  required  to  achieve  the  required  level  of  fidelity. 
Under  such  conditions  fluctuation  i nte rfe rence  leads  to  no  errors  at  all. 

I.rrors  are  caused  by  impulse  interference,  interruptions  in  switching  channels, 
and  other  factors  which  in  principle,  can  be  completely  eliminated.  In  this 
regard  the  opinion  is  widely  held  among  engineers  that  in  wire  communication 
fluctuation  interference  is  of  no  interest  and  a  general  communication  theory 
which  devotes  principal  attention  to  gaussian  interference  is  not  needed  for 
wire  technology.  Such  neglect  of  theory  is  a  result  of  exceedingly  ineffective 
use  of  channel  earning  capacity.  If  use  is  made  of  rational  multiplexing 
methods,  it  is  possible  to  increase  the  rate  of  transmission  of  information 
over  such  channels  by  many  times  and  then  the  limiting  factor  prohibiting  fur¬ 
ther  increase  in  rate  of  transmission  with  a  given  level  of  fidelity  (or  vice 
versa,)  is  just  exactly  fluctuation  interference. 


Unfortunately,  the  theory  of  multiplexing  communication  channels  is  still 
largely  undeveloped  and  our  knowledge  in  this  field  is  not  much  greater  than 
what  was  contained  in  the  work  published  by  L>.  V.  Agevev  [ 2 J  in  1935  (see 
also  [3J,|.  The  theory  of  concentrating  channels  is  even  less  developed.  In 
this  chapter  the  author  will  make  no  attempt  to  create  a  well-ordered  and  com¬ 
plete  theory  of  multiplexing  but  will  attempt  the  modest  task  of  combining 
certain  ideas  expressed  in  different  magazine  articles,  or  perhaps  not  pub¬ 
lished  anywhere  although  generally  accepted,  and  give  the  reader  an  idea  of  the 
problems  found  in  communication  theory.  In  light  of  the  subject  matter  of  the 
book ,  we  will  discuss  transmission  of  discrete  messages  only. 
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eacn  of  which  carries  information  about  the  message  from  only  one  of  the  sources 
We  will  call  such  multiplexing  systems  separable.  The  total  signal  ::(t)  is 


9.2.  Classification  of  Multiplexing  Methods 

\t  the  present  time  there  is  no  satisfactory  classification  of  methods 
for  multiplexing  communication  channels.  The  subdivision  of  systems  of  multi¬ 
plexing  into  frequency  and  time  multiplexing  which  is  found  in  main'  works  does 
not  hold  up  under  close  scrutiny  inasmuch  as  it  does  not  encompass  those  methods 
which  have  found  wide  use,  to  say  nothing  of  other  possible  systems  which  for 
0110  reason  or  another  are  not  used. 


In  order  to  approach  possible  classification  schemes,  we  will  concentrate 
our  attention  on  a  signal  passing  in  a  multiplexed  communication  channel.  In 
many  systems  this  signal  ;(tj  can  be  represented  in  the  form  of  a  s.en  k  of 
different  k  of  different  individual  signals: 


lie.- J.- 


often  called  a  group  signal.  !f  each 
rn  realizations,  '  |^  ( t  J  ;  r  =  1  .....  in ; 
are  independent,  the  group  signal  has 


of  the  individual  signals  ( t  |  has 

i  =  1 . k  and  the  transmitted  messages 

k 

m  realizations. 


Individual  signals  may  be  orthogonal  in  the  general  or  intensified  sense, 
orthogonal,  opposite  (when  m  =  2),  or  arbitrary.  An  especially  important  case 
occurs  when  realization  of  each  individual  signal  is  orthogonal  to  all  realiza¬ 
tions  of  the  remaining  individual  signals.  Such  separable  multiplexing  systems 
will  be  called  orthogonal.  IV e  will  note  that  realizations  of  a  group  signal 
in  this  case  are  not  mutually  orthogonal.  Only  in  one  particular  case  does  a 
group  signal  of  a  separable  system  form  a  biorthogonal  system.  This  occurs 

when  k  -  2  and  m  -  2  if  realizations  of  an  individual  signal  ' ^ ' 1 ( t )  are  oppo¬ 
site  [  I**  =  -  \  ;  f  “  1  ft)  =  -  ( t )  J ;  and  each  of  them  is  orthogonal  to  reali- 

*“  f  1  ]  ./■■'I 

zations  of  the  other  individual  signal  ['  (.  t )  •,  (t’)|, 

The  known  systems  of  frequency  and  time  multiplexing  are  examples  of 
separable  systems.  In  the  first  ease  individual  signals  usually  are  simple, 
i.e.,  each  element  is  a  segment  of  a  sinusoid  and  the  different  individual 
signals  have  their  own  frequencies.  If  the  difference  between  these  frequencies 
ate  divisible  by  1/T,  the  system  of  frequency  multiplexing  is  orthogonal.  Also, 
frequency  multiplexing  system  can  be  considered  approximately  orthogonal  if  the 
frequency  differences  are  much  greater  than  1/T.  In  the  case  of  time  multiplexing 
individual  signals  do  not  overlap  in  time.  lor  this  purpose  the  length  of  element 
T  is  subdivided  into  k  parts  and  each  individual  signal  is  assigned  its  own 
interval.  Obviously,  time  multiplexing  systems  are  orthogonal.  Incidentally, 
this  orthogonality  can  be  disrupted  if  during  passage  through  a  channel  the  in¬ 
dividual  signals  are  distorted  so  that  mutual  overlapping  occurs. 

Understandably,  separable  multiplexing  systems  are  not.  limited  to  frequency 
and  time  multiplexing  systems.  It  i s  sufficient  to  select  any  ml  rca 1 i rat i ons 
and  distribute  them  over  k  sources  in  order  to  construct  a  separable  system  with 
a  code  base  m  for  each  individual  signal.  In  the  particular  case  when  these 
realizations  are  made  orthogonal  or  biorthogonal,  it  is  possible  to  construct  an 
orthogonal  separable  multiplexing  system. 


In  other  systems  a  signal  in  a  multiplexed  channel  cannot  hi*  represented 
in  the  form  of  ((J .  1 )  but  its  envelope  or  its  instantaneous  phase,  instantaneous 
frequency,  or  sore  other  parameter  amounts  to  the  sum  of  individual  signals. 

In  those  systems  which  can  be  called  uuas i -sopa rah lo ,  a  transmitter  signal  in 
a  multiplexed  channel  is  obtained  through  modulation  of  a  certain  carrier  fre¬ 


quency  by  a  group  signal  Thus 
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in  the  case  of  amplitude  modu'a* ion 
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in  the  case  of  phase  modulation 
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in  the  ease  of  frequency  modulation 

2(1 )  A  cos 


.,/  !  ,1*  V  V‘Ut) 

I  :| 


'•.Al  l*,  [V  ("If/), 


e  t  e . 


(9.2b) 


(9.2c) 


Therefore,  such  multiplexed  systems  are  often  called  binary  modulation 
system.-.  Sometimes  separable  systems  are  relegated  to  them  under  the  assump¬ 
tion  that  a  transmitted  signal  is  formed  by  means  of  single  pole  modulation  of 
the  carrier  frequency  by  a  group  signal.  However,  inasmuch  as  single  pole 
modulation  and  demodulation  amount  to  shifting  a  spectrum,  it  is  more  convenient 
to  view  the  shaping  of  a  transmitted  signal  in  separable  systems  as  simple 
addition  of  individual  signals. 

There  also  exist  systems  of  multiplexing  in  which  neither  the  transmitted 
signal  nor  any  of  its  parameters  can  be  represented  in  the  foiin  of  a  sum  of 
individual  signals.  They  could  be  called  inseparable  but  usually  they  are 
called  combination,  l.ach  signal  element  in  such  a  system  must  carry  informa¬ 
tion  about  the  messages  of  k  sources.  If  each  of  them  is  encoded  using  a  code 

base  m,  a  signal  element  must  for  this  purpose  have  m^  realizations  just  as  in 
separable  systems.  However,  there  is  a  freer  selection  of  these  realizations. 
Spec i f i cal Iv ,  they  can  form  a  system  which  is  orthogonal,  hi orthogona 1 ,  or 
orthogonal  in  the  intensified  sense.  It  is  also  possible  to  construct  a  system 
with  a  given  conditional  frequency  band  of  signals  with  as  large  a  number  of 
sources  as  desired. 

In  order  to  conclude  c 1  ass i  f i cat i or  of  multiplexing  systems,  it  is 
necessary  to  consider  the  existence  of  mixed  systems  in  which  the  sources  art 
subdivided  into  groups,  within  each  group  combination  multiplexing  occurs,  and 
the  obtained  signals  are  added.  Thus,  combination  and  also  separable  multi- 
I  ''".1  tg  occur  here.  An  example  is  provided  by  the  well-known  kineplex  system 
[  IJ  in  which.  10  sources  are  subdivided  into  20  groups  of  2  sources  each,  the 
messages  from  each  pair  of  sources  form  a  combination  signal,  and  all  these 
signals  arc  added  just  as  in  orthogonal  systems  of  frequency  multiplexing.1 

As  can  be  seen  fn",n  the  examples  presented,  multiplexing  is  nothing  other 
than  simultaneous  encoding  of  messages  from  several  sources  during  which  process 
.1  signal  common  to  till  is  formed.  This  encoding  can  occur  in  a  discrete  channel, 
for  example,  during  time  and  combination  multiplexing,  or  in  1  continuous 


*()fton  the  kinexplex  system  is  us< d  to  transmit  messages  from  one  and  not  from 
till  40  sources.  In  this  case  it  should  not  he  considered  a  multiplexed  system 
but  a  communication  system  with  a  code  base  of  m  -  2"'.  this  permits  increasing 
the  length  of  an  element  by  40  times  in  comparison  with  a  binary  system  for 
transmitting  in  a  channel  with  multibeam  propagation  using  the  protective  1  r. 
terval  method  (see  Section  "..A). 
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channel  (with  frequency  multiplexing,  and  in  most  other  separable  and  quasi  - 
separable  systems). 

Along  with  classification  of  multiplexing  systems  based  on  the  method 
of  shaping  a  signal  in  a  channel,  they  can  also  be  subdivided  into  synchronous 
and  asynchronous.  In  synchronous  systems  sources  emit  information  at  the  same 
rate  or  at  multiple  rates  and  each  signal  element  has  a  strictly  defined  length 
T.  In  asynchronous  systems  sources  can  emit  information  at  a  varying  rate. 

In  separable  asynchronous  systems  the  individual  signals  can  be  synchronous  but 
in  a  total  group  'gnal  the  starts  of  elements  oi  the  individual  signals  do 
not  coincide,  h  l1  be  mainly  concerned  with  synchronous  systems.  The 
suggested  cl  ass i f i cat i on  of  multiplexing  systems  is  shown  schematically  in 
figure  y.l.  Seme  of  the  terminology  used  will  become  clear  in  what  follows. 


Figure  9-1.  Classification  of  Multiplex  Systems.  Key: 
a,  Multiplexed  Systems;  b,  Synchronous;  c,  Asynchronous; 
d,  Separable;  e,  Quas i -separao  le  (with  binary  modulation); 
f ,  Combination;  g,  Address;  h,  Mixed;  i,  Orthogonal;  j,  Non- 
or thogona I ;  k,  Time  multiplexing;  1,  Frequency  multiplexing; 
n: ,  MNT ;  n,  MPT;  o,  MRPT ;  p,  Kineplex;  q,  Other  orthogonal 
separable  systems;  r,  Other  nonor t hogona 1  separable  systems; 
s,  Other  orthogonal  combination  systems;  t,  Other  nonortho- 
gonal  combination  systems;  u,  Other  mixed  systems. 

"he  great  variety  of  systems  for  multiplexing  pc  mi  its  selecting  in  each 
particular  case  a  variation  pividing  for  the  best  possible  use  of  carrying 
capacity  of  a  channel  while  retainin'.'  a  high  level  of  fidelity  in  transmission. 
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9. 3.  Reception  Criteria  and  Decision  Systems 

In  any  synchronous  system  for  multiplexing  an  element  of  a  received 
signal  carries  information  about  messages  issuing  from  all  k  sources.  Let  a 
message  from  each  source  be  encoded  using  a  code  base  of  m.  Then,  as  already 

indicated,  the  number  of  realizations  of'  signal  is  equal  to  m  .  If  the  require¬ 
ment  of  maximising  the  probability  of  correct  reception  of  all  transmitted 
messages  is  stipulated,  the  decision  system  must  be  determined  by  the  criterion 
of  the  ideal  observer.  In  the  particular  case  when  ail  realisations  of  a  signal 
are  equi probab 1 e ,  this  criterion  coincides  with  the  criterion  of  maximal  likeli¬ 
hood  . 

Let  z'(t.)  be  a  received  signal.  The  decision  system  which  is  based  on  the 
criterion  of  the  ideal  observer  must  identify  it  with  that  one  of  the  possibly 
transmitted  signals  z;(t)  for  which  the  following  system  of  inequalities  is  met: 

/>  ('ll  •"  !  p  l-’r !  s'). 


After  determining  the  most  probable  transmitted  signal  s,(t)  and  knowing 

the  design  of  the  system,  it  is  possible  to  unambiguously  establish  which  symbol 
was  transmitted  by  which  source. 


Although  decision  principle  (9.5)  provides  for  a  maximum  probability  of 
correct  reception  of  all  messages  in  a  multiplexed  channel,  it  does  not  always 
guarantee  a  minimum  probability  of  error  p.  in  each  of  the  messages.  This  can 

be  easily  understood  when  it  is  considered  that  in  the  case  of  incorrect  iden¬ 
tification  of  a  received  signal  z'(t)  with  transmitted  signal  z.(t),  not  al ! 

messages  will  b  received  error-free.  The  criterion  of  the  ideal  observer,  on 
the  basis  of  which  principle  (9.3)  was  obtained,  pertains  to  the  entire  received 
signal  and  minimizes  the  probability  of  false  identification  of  signal  p. 
regardless  of  how  many  me  sages  are  destroyed  by  error  in  the  process. 


If  the  -probability  of  error  in  each  of  the  messages  must  be  minimized, 
the  criterion  of  the  ideal  observer  must  be  applied  to  separate  messages,  he 

will  consider  the  i-th  source  in  a  multiplexed  system.  All  n^  realizations  of 
signal  z^(tj  can  be  subdivided  into  m  subsets,  each,  of  which  corresponds  to  one 

of  the  symbols  of  the  i-th  message.  The  decision  system  at  which  signal  z'(t) 
arrives  must  determine  the  a  priori  probabilities  of  all  symbols  in  a  given 
message  and  select  from  them  the  one  for  which  it  is  maximal.  In  other  words, 
symbol  t.  must  be  recorded  in  the  i-th  message  if 
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i'W'1’,  tlu*  iv  i  iv  sv-  i"".s  I'm-  ui'i.-ii  principle  I.1. 9)  and  |  9 . 9  i  an  nci  cipi  i  v;i  lent 
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she  .i  :  !'.■  iii'  r:.  me..  ’'.iso  i  :  ••  ro-tu.  ri  verm  siiudo  o'  th<  omruiu  rat  ion  system 

.mil  Is  n..  t i .  o!  tie  It  ;  i  i  t  T .  • !  rvsvu’c<  .  lor  e  .ni'i'li  ,  let  re  iut'.i.iney  he 
ili.  ,  Ti.it  "9  ,  i  -  • ;  r .  harm,;  cm  o.iurr  =  > 'he  '•  e  •  sapen  .  !  tier.  am  error 

oe«  i '  r  .hirn.n  :-•••  ;  •■:!  v  :  1 1 !  •.  r-  .iln-t  ,i !  |  iv-sapm  useless  .in  .1  in  some  eases 

e.i,"  •  1  a.  ;  iirei.irihi  !iv:  1  ti  'hi  si  tu.it  i .  >n  1 1  would  he  incorrect 

'  •  t  r  ;  \  •  in  .  1 1  • .  i  •  ■  ■  i\vr  i.p.  in.:;. hi  r  ot'  error  in  a  ress.ipo  and  t..  1  P'-oha- 

i  >  i  lily  :  e  i'rc'1'- f:v<  r'vvpi  :  n  I  an  •  >»;  •  re  mes  •  ape  •.  h.  a.  Ul  ho  increased.  Ini' 

•  1  •.  ,  •  9.  e  i  •  >  r  ■  \  '  :  u;.. ,  1,  pro  id"s  in  .9  ol  all  rases  for  error  tree 

••  •*'  r  •  n.  .•••  a.-:  i.  tin  t  van  in. :  .a''  ,  !'  ill  rases  one  incorrectly 
i  .i  ..  a  si.  is,  |  will  |  A,'.  ,i  van  another  .ieci-ier  s  vs  tor  win  eh  p  rovi  di-s  lor 

9  1  >.  rvi  -iron  n  •  :  t  t  n-.  and  in  ‘ha  r  ■viininr  Iu”  el  all  c.e-os  1U0  invrreet 

1 1  ’ ;  • :  .•  i  tie  ••v.n.l  a  .  Vie  vvape  r  o'  en'ors  is  20  times 

.  t  r  1 1;  it:  . ::  th-  r  t.  '!•...  is  1 ,  ;  i.  such  •;  1 1  u.ii  i  ..»is  it  1  ’•  ad\  isahie  to 


in  any  synchronous  system  as  obtained  through  encoding  all  transmitted  messages 

using  a  code  with  a  bast,  of  in*'.  ’I  hen  j\  represents  simple  tin-  probability  of 

error  in  a  communication  system  with  a  code  base  ol  n  and  the  task  of  computing 
it  is  nothing  other  titan  that  cons  ide  red  in  preceding  chanters.  It  is  true 
that  it  is  not  solved  in  all  cases.  below  wo  will  give  i  solution  of  it  for 
a  few  multiplexing  systems,  he  will  also  give  expressions  for  p.  . 

Regardless  of  tlu  ilecision  principle,  the  prohahilitv  ol’  error  in  a 
Uta!  signal  p  and  the  probability  of  ••rror  in  t  hi*  i  th  message  are  related 

by  tlu'  following  inequalities 


max /a  (9.0) 

Indeed,  inasmuch  as  p  represents  the  probability  that  at  least  one  of  the 

messages  is  received  correctly,  it  may  not  ho  less  than  the  probability  of  error 
p.  i  r.  any  of  the  messages  and  at  the  same  time  may  not  he  greater  than  the  sum 

of  the  probabilities  of  error  in  all  messages.  The  first  inequality  becemes  an 
equality  it  the  errors  in  the  messages  occur  simultaneously;  the  second  in 
cqualitv  becomes  an  equal it\  it’  with  any  incorrect  i dent i f i ca l i on  of  signal  the 
error  occurs  in  only  one  of  the  messigcs. 

he  will  use  pj  and  p"  to  den.it-.  the  prohahi  i  i  t  i  es  <d’  error  in  the  i  -  th 

message  when  using  decision  principles  <9  di  and  (9..~i  r<  spect  i  ve  I  v .  he  v*  i  1  1 
use  p.’  and  p!’  for  tb.e  probabilities  of  incorrect  i  dent  i  l’i  cat  i  n  of  a  multiplexed 

signal,  from  the  essence  of  the  criteria  useJ  in  deducing  tin-  lecision  principle 
we  nave 


r"<-  r't. 
r-  i" 


(  oim>  i  nod  use  of  inequalities  i  *>.(.;  and  *.» . 7  :  oennits  v.  iluati.n  of  tin-  clumge  in 
probabilities  of  error  in  t  rans  item  from  one  de.  i  si  ‘*n  principle  t  ••  .riot  her  .  Tnu 

/>'(„  mu  />',  '  -/'"■• 

where  p.  =  I ,'!.  V />,  is  tb.e  average  r  re!  abi  life  of  error  in  il!  n  >••.!.•'  •  ,  whence 
1  i  av  ' 

i 

p">:,  '  •  -V'.. t.  .  ''-‘.s' 


Or  the  other  hand, 
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For  some  multiplexing  systems  these  equalities  will  be  made  more  exact  in  what 
fo 1  lows  . 


9.4.  Separable  and  Quas i -Separab  1  e  Multiplexed  Systems 


Orthogonal  Separable  Systems 


In  orthogonal  separable  systems  realizations  of  individual  signals  •  1  *  (.  t  J 
in  (9.1)  for  diffeicnt  messages  are  orthogonal.  Different  realizations  of  one 

individual  signal  fur  various  r)  may  in  this  case  not  be  orthogonal.  We 


will  assume  that  orthogonality  is  retained  even  after  passage  of  a  signal  through 
the  channel.  This  means,  for  example,  that  for  a  channel  with  randomly  changing 
phase  orthogonality  must  be  met  in  an  intensified  sense.  The  condition  of 
orthogonality  retention,  at  least  in  the  first  approximation,  can  be  met  for 
all  channels  used  in  practice  through  a  suitable  selection  of  signals. 


If  orthogonality  is  provided  in  such  a  way  that  the  signals  do  not  overlap 
in  time,  a  system  with  time  multiplexing  results,  for  each  source  part  of  the 
length  of  signal  element  f  equal  to  T/k  is  separated,  in  channels  with  a  limited 
passband  or  multi  beam  propagation  it  becomes  necessary  for  the  purpose  cf  re¬ 
taining  orthogonality  to  use  the  entire  interval  but  only  that  part  of  it  equal 
to  T/k  -  i  .  where  ;  is  the  maximal  stretching  of  the  si  glia’  as  it  passes 

through  the  channel. 


In  the  case  of  frequency  multiplexing,  if  the  individual  signals  are  simple 
segments  of  sinusoids  with  frequencies  multiples  of  l/'i  ,  orthogonality  is  dis¬ 
rupted  with  rather  fast  fading.  Incidentally,  under  usual  conditions  of  a 
shortwave  radio  channel  when  f  is  on  the  order  of  tens  of  milliseconds  or  less, 
these  disrupt'1  oms  in  orthogonality  can  be  ignored.  With  more  rapid  fm  ing  or 
with  a  greater  length  of  signal  element,  in  the  case  of  frequency  multiplexing 
approximate  orthogonality  is  achieved  by  using  narrow-band  individual  signals, 
spreading  them  in  frequency  so  that  the  spectra  for  all  practical  purposes  do 
not  overlap  even  when  widening  of  the  spectrum  dine  to  failing  is  taken  into 
account  . 


Of  course  other  orthogonal  separable  systems  of  multiplexing  are  possible 
although  they  have  not  yet  found  practical  application. 

Wo  will  consider  a  decision  circuit  for  an  orthogonal  separtbb  system 
based  on  the  decision  pitnciple  of  (9.bl.  io  simplify  the  problem  we  will  limit 
ourselves  to  a  gauss  i  an  channel  with  constant  paianieters.  fit  us  also  assume 
that  all  messages  are  statistically  independent  and  that  the  symbols  of  the 
messages  are  equ i probab le .  Inasmuch  a  9.x)  coincides  with  the  decision  prin¬ 
ciple  for  a  signal  which  is  not  multiplexed  when  the  code  base  in  n ^ ,  the  de¬ 
cision  that  group  signal  z.(t!  was  transmitted  must  he  reached  in  accordance 
with  (3. 24a)  if 
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Accord inj*  to  (P.l),  for  a  separable  system 


where  the  subscript  ri  i  ml  i  cat  os  that  individual  signal  which  corresponds  to  the 
i - 1 h  message  in  group  signal  z,(t).  Substituting  this  expression  in  (9.10)  we 
obt  a i n 
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(9.  1  1  ) 


After  substituting  (9.11)  in  (9.10),  considering  the  condition  of  ortho¬ 
gonality  and  assuming  that  all  signals  z  (t.)  have  the  same  power,  we  obtain  an 

equivalent  decision  principle  in  the  form 

*  ‘  r  h  i 
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where  the  inequalities  must  be  met  for  all  com!  illations  of  individual  signals 
*|  ft)  which  differ  from  that  combination  which  forms  group  signal  r  .  ( t  ;  . 
Consequently,  1.9.  Id.)  must  also  be  met  for  group  signal  z  (tl  which  differs 
from  z.(t)  only  in  the  symbol  in  a  certain  i-th  message.  Consequently,  system 
of  inequalities  (9.  Id)  is  juivulent  to  system  ('A.  Id). 


r  I _ nr,  r  j  I  • 


This  principle  must  be  realized  in  the  decision  circuit  containing  mh 
filters  matched  with  all  realizations  of  individual  signals  ft)  (figure  9.2) 
to  which  the  received  signal  is  delivered.  At  instant  ol  readout  the  voltages 

in  each  group  of  m  filters  matched  with  realizations  ot  individual  signals  '  ^  (t  ) 

are  compared  and  decisions  reached  for  each  message  separately. 

It  can  easily  be  seen  that  principle  (9.91  can  be  relegated  to  such  a  de- 
c i s i on  c i rcui t  . 

We  can  consider  the  reception  of  signals  in  accordance  with  ,9.3)  and 
(9.3)  for  a  channel  with  a  randomly  changing  phase  altogether  similarly  and 
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1 1  mj  t'u:  any  diaiim  1  with  canal  U  pa  ramet  <  i  s  on  condition  th.it  individual 
signals  ol  .iriaiii  ;;.c  s  s  remain  o  rt  hoyuna  1  at  tin  output  ol  the  onaiiin  1. 

In  al  i  c.is(  s  t!u'  Joe  l s 1  on  circuit  is  r-ubd  i l.  i  Jed  into  I  separate  circuits  I'm 
each  r.essap  ,  each  t'  winch  coincides  with  the  decision  ciidiit  lor  nidiciduai 

signal  M|t!  used  without  nu  1 1  i  p  lex  l  m; .  ■  I  h  i  s  could  have  been  assur.ed 
earlier  inasmuch  as  the  signal  does  not  affect  t  he  result  of  optimal  process  ini1, 
i  f  the>  are  ort  ii  piia  1  . 


1  hus  ,  t'or  orthogonal  separable  s>  stems  principles  ( 9 .  a )  and  (9. a)  are 
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In  a  channel  without  I'adim;  errors  in  ditfeient  messages,  otn  i  otis  1  y ,  arc'  not 
alculated.  Ihrreforr.  the  pr  ;ii>i  1  ■  t\  et  error  p  in  the  total  signal  :s 


ns  result  holds  true  only  when  all  "le-  ■  i^es  are  statistically  independent  . 
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From  (9.14)  it  is  apparent  that  when  in  .1  the  equivalent  p  re!  ab  i  I  i  t  \  of  error 
n  e a i ne i des  w i t h  p .  . 

In  a  fading  channel  .aid  also  in  the  case  of  la::.)  ed  oi  impulse  uiU  i- 
fercnce  errors  in  different  messages,  generally  speal-  i  ng ,  are  com*  1;.  ted  and 
the  dependence  between  p  and  p.  is  more  complex.  1  he  degree  of  this  corre¬ 
lation  depends  on  the  properties  of  the  channel  and  the  specific  multiplexed 
system.  Thus,  in  the  case  of  selective  fading  and  frequency  multiplexing, 
errors  in  the  i -til  and  j-th  messages  are  weakly  correlated  if  the  spectra  of 

signals  •  ^  and  are  sut  f  i  cient  ly  spread.  In  t  lie  case  ot  nitre  Iv  :  mpu  lse 

interference ,  errors  are  stronglv  correlated  fir  frequence  multiplexed  systems 
and  are  practically  not  cvrrelatbd  for  time  multiplexed  systems,  and  in  the  ease 
of  lumped  interference ,  vice  versa. 

We  will  determine  the  least  possible  band  occupied  by  a  group  signal  in 
an  orthogonal  separable  multiplexed  system.  This  parameter  is  important  because 
it  permits  us  to  judge  the  effective  width  of  spectrum  and  this  is  especially 
important  in  multiplexing  a  channel  when  1 i m i tat i ■  -n-  are  imposed  on  the  trans¬ 
mission  frequency  band. 

A  set  of  el  ‘incuts  of  signal  of  length  I  occupying  a  possible  band  of  fre¬ 
quencies  I-  is  isomorphic  to  vectorial  b-di  mens  i  onal  space  where  !'  -  _TT  ;  the 
signal  base.  Inasmuch  as  the  orthonoma]  basis  of  such  a  space  certains  h  vectors 
the  maximum  number  of  mutually  orthogonal  signals  is  equal  to  -'ll.  We  will  note 
that  there  is  an  infinite  number  of  orthogonal  systems,  each  of  which,  has  its 
own  orientation  of  basis  vectors. 

It  can  easily  be  shown  that  tile  maximal  number  oi  signals  mutually  ortho- 

goti.il  in  the  intensified  sense  is  half  this  magnitude.  We  will  .  ons  i  der  a 

complete  system  S  of  signals  orthogonal  in  the  intensified  sense  which  i..n,e 

been  normalized  in  power.  Let  z  (t)  be  or  of  these  signals,  signa!  r 

r  r 

conjugate  with  it  does  not  enter  this  system  sin  e  it  dans  not  s.iti  iA  the  con¬ 
dition  of  orthogona  1  i  t  v  in  the  intensified  sense  with  z  It  ■  .  lioi-cvii  .  ;*  1: 

-  r  ' 

orthogonal  to  z  ( t j  in  the  ordinary  sense  and  aJ  s»  to  ail  rem.ii  ■:  i  i.g  s ;  gn.i  1  s  of 

the  system  by  definition,  i  u  rthernore ,  two  signals  .onji.ga'e  with  an;,  t other 
signals  of  a  system  are  orthogonal  will;  oik-  another  and  consequent  iv  do  not 
coincide.  Therefore,  by  adding  conjugate  signals  to  system  s,  we  .'tain  i 
system  of  signals  which  are  pairwise  orthogonal  in  the  rdirary  sense.  ill  is 
system  is  complete,  for  otherwise  it  would  be  neecssarv  ti  add  to  it  a  *-ignal 
z^ftj  orthogonal  to  all  signals  of  the  initial  system  v  and  signals  eor  uig.it  e 

with  them,  i.e.,  orthogonal  to  all  signals  of  :>sUn  in  tlie  inters  i  I  i  ed  morse, 
and  this  contradicts  the  supposition  that  S  is  a  comp  let.  -ystem  ot'  signals 
orthogonal  in  the  intensified  sense.  1'onscqucnt  iy  ,  svstem  *'<  contains  e*.  i.'tlv 
half  the  signals  of  a  complete  system  orthogonal  in  t  >-.:inir>  u'lmi  ,  .  .  c- .  , 

IT  signals. 
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aiul  arc  practically  not  ex  rrd  tted  lor  t  i  r,t  *’  u  1 1  :  p  1  •  xcd  systems  .  ami  :  n  tin  r.i-c 
ol  !  '.imped  i  nt  c  rl V rcncc  ,  \  :  ce  .er-ci. 


1% ■  •  will  v.etermir.e  the  least  possible  lam!  occupied  ty  a  gicup  signal  in 
an  .  rthogonal  separable  multiplex'd  system.  Ihis  parameter  is  important  K  i  an  so 
it.  permits  Us  to  judge  the  effective  width  ot  spectrum  and  thm  is  especially 
important  in  multiplexing  a  channel  when  limitations  are  imposed  on  t  he  tians- 
m lesion  frequency  band. 


A  set  ■  t  elements  ol  signal  of  length  1  occupy  nut  a  possible  band  of  fre¬ 
quencies  I  l  isomorphic  to  vectorial  b-di mens i onu 1  space  where  b  -'1  I  .  -  the 
signal  base.  Inasmuch  as  the  or thonoma 1  basis  of  such  a  space  contains  h  vectors 
the  maximum  number  of  mutually  orthogonal  signals  is  equa.  to  J!  1.  a e  will  note 
that  there  is  an  infinite  number  of  orthogonal  systems,  e  ch  c'!'  whi.i.  has  its 
own  orient  it  ion  of  basis  tec  tors. 


It  can  easily  lie  shown  that  the  maximal  numbei  of  sign  i  Is  ".ntn.d  !y  eft  l.u- 
genal  in  the  intensified  sense  is  halt'  this  magnitude.  he  will  consider  a 
complete  sy  .ter  s  of  signals  orth.gona  1  in  tie  ir.ten-  itied  sense  which.  ).a\e 

been  normalized  in  power.  let  ;  it)  be  one  of  these  sigimls.  Siriial  :  t 

r  r 

conjugate  with  it  does  not  enter  tins  system  sin*  e  ;  t  do*  s  in.:  sat  i  ■  i  >  tine  .  on  - 

c.ition  of  orthoiona  1  i  t  v  m  the  intensified  sense  with  a  it.  i:  .wevt  i  .  ;  t  . 

- '  •  r 

orthogonal  tc  z  (t  in  the  v.rdin.iry  cn.-e  and  aP.  n  all  n  i:.ai  l  in.  •- . 1  -  of 

the  system  by  definition.  I  urtherr.ore  ,  'we  signals  c  c  i:  i  i.g.ile  with  .up.  :  .c  ether 
signals  of  a  system  are  orthogonal  with,  one  mother  and  c  ,  nsequt  nt  ly  do  net 
coincide.  1  hero  fore,  by  adding  conjugate  signals  to  svstem  N .  w  *  '  t a  i  n  . 
system  of  signals  which  are  pairwise  orthogen.il  ;  n  tin  rdn.ary  sem-e.  1 1;  i " 
system  is  complete,  for  otherwise  it  would  be  i.evssarv  p  add  t-  i:  signal 

c  1 1 J  orthogonal  to  all  signals  of  the  initial  syster  u.d  •«  i  cn  I  *•  c.  e  ■  ug.it  e 

wi  ch  them,  i  .  e .  ,  orthogonal  to  all  signals  of  s\  m»  r.  ‘  in  the  inf  e---  :  l  i  e.!  .re, 
and  this  contradicts  the  supposition  that  w  is  i  c  •  m.;  !.  P  sp  r  if  cpi.i  - 
orthogonal  in  the  intensified  sense.  Consequent  iy  .  -o'-te1'  '•  .uit.in  e>  fix 
half  the  signals  of  a  complite  sy  -ti-u  ertingon.i!  in  tm  .  :u  ir>  •<::<.  .  ,  .  •  .  , 

I  T  si  gna  1  s  . 


-U  x 


Now  it  is  possible  to  determine  the  minimal  value  of  the  eomlitional  fre¬ 
quency  band  of  an  ortlogonal  separable  multiplexed  system  if  the  number  k  of 
multiplexing  messages  nd  the  code  base  m  for  each  of  them  are  given.  When 
m  =  2  a  system  is  possible  in  which  two  realisations  of  an  individual  signal 

l*'(t)  are  opposed,  and  orthogonality  with  the  other  individual  signals  is  met 
in  the  ordinary  sense.  Then  k  _  2 IT,  whence 

r *,  .  (9.  IS) 

Such  a  system  permits  only  coherent  reception.  With  incoherent  reception  ortho¬ 
gonality  must  be  met  in  the  intensified  sense.  Two  realizations  of  au  individual 
signal  can  in  this  case  be  opposed  if  relative  phase  modulation  is  used.  Then 

•*  .  (9.  lt-l 

This  formula  remains  valid  also  when  m  2  if  m  realizations  of  individual  signal 

•  *  1  *  (t  i  are  formed  .n  the  form  of  a  linear  combination  of  one  realization  of  ■  (t) 

and  realization  "jUl  conjugate  with  it.  Most  frequently,  however,  systems  arc 

used  in  which  all  realizations  of  individual  signals  are  mutually  orthogonal  in 
the  intensified  sense,  for  example,  Ik  systems  with  frequency  or  time  multi¬ 
plexing.  Since  the  total  number  of  realizations  is  mk ,  for  such  systems 

mb 

*•••"  •/’  *  19.1  ) 

Thus,  if  the  length  of  element  I  is  given,  in  all  orthogonal  separable 
systems  the  conditional  frequency  band  f  is  proportional  to  the  multiplexing 
factor. 

Nonor thogona 1  Systems 

In  nonorthogonal  separable  multiplexed  systems  the  probability  of  error  p. 

for  the  i-th  message  depends  on  what  symbols  the  remaining  messages  contain. 

Thus,  in  using  the  decision  circuit  of  figure  9.2  the  voltages  at  the  output  of 
the  matched  filters  at  instant  of  readout  depend  not  only  on  the  individual  signal 

of  the  corresponding  message  '^*'(t)  but  on  all  remaining  individual  signals. 

I.et  signal  z'(t)  -  .  zjtl  ♦  n ( t  1  ,  where  z(ti  is  a  group  signal  (9.1).  arrive 
at  the  input  of  a  filter  matched  with  a  certain  realization  of  individual  signal 

'^•'NtJ.  fhe  voltage  at  filter  output  at  instant  of  readout  is  proportii-n.il  to 


*  l 

\  l/if  t.*i I1  f  '  i 1 1 


•!  V  i»  (:  " i.'i*'  dm  '•  ■  ( -  Cl 
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i- here  •'  *  ( 1 1  is  i  rea  1  i  ;a  t  1  on  of  the  i-t'i  individu.,1  signal  cent  a  i  ned  in  :(t 

I  he  t  i  rst  term  in  fi'.lN)  represents  tin  useful  voltage  eoiitaininr.  inform.i  n 
about  the  transmitted  message  ami  the  last  ten::  is  the  action  of  the  additive 
i  n  t  e  rfe  rene  e  .  Ihe  sin:;  form  nr.  the  sev  olid  term  is  a  random  1  tic  las  a  conse¬ 
quence  of  the  randomness  of  rea  I  i :  a  1 1  on  *  1  1  ( r  •  I  not  currying  information  about 
a  transmitted  symbol  in  the  i  th  message,  i.e.,  it  amount s  to  additional 

s\  stem  i  liter  fe  renre .  It  is  usually  railed  transient  i  nt  e  rfereiire . 

Obviously,  th<'  e  \  i  s  t  etire  (>t‘  transient  inter  f  e  re  n  re  ir.rreases  the  proh.i 
bilit>  of  error  more,  the  stronger  is  the  deviation  fror  orthogonality  and 
the  higher  is  the  nil  1 1  i  p  lev  i  in:  fartor.  lor  e.ieh  spent  iv.  s  vs  tern  t  lit*  probabilitv 
of  error  i  ran  be  calculated  in  final  form  er  redured  to  quadru’ures .  Ihe 

1  i 

distribution  of  probabilities  of  transient  interfen  nee  ran  be  eotnidered  normal 
lor  in  api'ro.vimate  evaluation  of  the  probability  of  error  when  the  ultt|  le.xing 
fartor  is  large.  Without  resorting  to  ralrulations  of  this  v>e  u  i  1  1  note  that 
the  probabilities  of  error  |  for  diff<  rent  messages,  general  lv  speaking,  are 

I I  t  l  e  relit  .  ' 

Ihe  only  advantage  of  nonort  liogona  1  -eparable  ".-terns  e\r:  orthogonal 

•  \ stems  is  the  possibility  et’  obtaining  an  arbitral)'  multiplexing  fartor  with 
i  given  signal  base  and  tins  permits  mu  1 1  i  p  I  ex  i  ng  rhannels  having  a  riven 

f  roquenev  band  I  with  an  arbitrarv  number  of  i:v  ••sagis .  However,  the  smaller 
t he  II  k  ratio  is,  the  more  or t hogona 1 i t v  is  disrupted  in  individual  ignals, 
i.e.,  fidelity  drops  as  a  consequence  o*'  transient  i  ntert'erenre .  \s  will  be 
shown  below,  the  best  use  of  ra living  rapivitv  of  a  narrow -band  channel  is 
provided  by  nor.o  rt  hogona  1  comb  irat  ion  svsters.  Ihercfen  ,  use  i<  never  mten 
’tonally  made  of  nonort  hogona  I  separab  It  systt  r.is .  I  hey  oerur  as  a  result  of 
disruption  in  orthogonality  in  a  separable  multipli.ving  system  wlurh  is  in  in¬ 
tent  orthogonal.  \s  already  noted,  such  disruptions  can  oecur  in  rhannels 
vs  i  t  h  fading,  with  multibeam  propagation,  or  with  a  long  impulse  reaction.  In 
designing  separable  multiplexed  systems  it  is  important  to  select  individual 
signals  so  that  under  the  conditions  existing  in  a  given  channel  or  a  channel 
with  a  long  impulse  reaction  use  should  not  be  made  of  time  multiplexing.  Use 
should  be  made  of  frequency  multiplexing  in  a  channel  with  fast  fading. 

I  lerient.in  ca  I  cu  I  at  i  otis  show  that  with  a  remissible  probabilitv  of  error 
p  10  *"  it  ,s  possible  in  the  first  approx  irat  i  on  tv'  ignore  disruptions  in 

o  rt  hogor.  I  i  t  v  it'  tlve  d  i  s  pv  r  s  i  on  ot  the  second  ten:  i  uni  in  '9.!'  does  pot 

•  ■  •  r  •  •  d  I  it  the  square  of  the  one  i  i  v  of  the  i  n  • 1 1  \  i .  ii  i  >  1  signal. 

Quas  i  -Separab  le  System'. 

In  principle  quas  i  -  separab  <  n  1 1  >:  i  p  I  e.xevl  sy-tems  with  double  modulation 
have  no  advantage  over  separable  s\  ,  terns.  Nevertheless,  t  In  \  are  widely  used, 
os per i  illy  in  radio  relay  and  tropospheric  channels  because  in  double  modulation 
the  requirements  ot  stable  frequence  up’  eased.  (Juas  i -sepa  rab  le  systems  also 
h  iv  *  several  merits  of  a  t  echno  1  og  i  ca  I  and  organ  i  ;at  i  mm  1  nature.  If  there  is 
in  apparat  is  which  permits  transmitting  telephone  signals  over  a  given  writ 
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n  .  .m.l  .i  I 

.  1 1  i ;  1 1  'ii.i 
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j  .  i  >  j  I :  c  thi  l>  l  ilol  i  n .  i  .  !..n!!n  !  it  ,  - 
.i'  i  ii.  tin  ox  i  t  i  i.r  .  i  ■  n;  .  i.n.i  i  . 
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opt  iim  I  .u  >  orJinc  to  t  t> .  JO  )  i  s  %..'•*  1 0  ami  in  .1  twonopt  i  n  .1  '•  system, 

.H  c  wd  1 14:  to  JJ:,  it  is  .'<*10 

I  h  1  s  seeming  paradox  .ii'ikc  K'imiim'  the  threshold  proport  us  <»|  phase 
modulation  were  not  takor.  into  ouiMilir.il  nm,  Indeed,  ratio  ('.'.Jot  is  valid 
onlv  whoa  t!u  noiso  ••r\i  topo  at  root- 1  \  v  r  input  is  much  loss  than  tho  sienal 
o::ii  iopo.  I'u t  orrors  do  not  occur  mult  r  those  conditions.  It  in  a.  channel  .  it 
n  1  .  I  r  a  tins  short  tm.o.  1  nt  e  rferi  r.ci  exceeds  t  lie  signal  or  beuimrs  cur.  - 
:  <  i  it  lo  ir.  I  <  \  «■  I  with  tho  signal  alter  durto.lu  1  .it  1  on  the  ratio  between  signal 
n  .  .  ntertorei  co  not  onh  does  not  nicrc.ra  but  i\or  doiioasos.  In  i  tlior  words 
t!i  '  1  i;n.il  at  those  list, mts  is  suppressed  by  1  nt  e  rt Vrenci  and  precoiuli  t  .  on<  ate 
O'!  ih  1 1  shod  tor  incorrect  svmbol  reception. 

i  bus  ,  t  or  put  ..it  1  on  of  probability  of  error  11.  a  nonopt  1  tr.a  1  system  with 

•hi  .  r.ovlu  1  it  1  on ,  which  led  to  the  result  p  .>•!('■  ,  was  performed  incorrect  1>  . 

!.  1  octet  analysis  it  is  neo-oarv  to  use  ii'ofead  of  1 1  »._*.> )  .  the  more  complex 

di'p.  t  vlerce  between  the  strength  ot'  the  signal  at  the  input  and  the  strength  ot 

th  iiinal  at  tho  output  ot'  t  he  demodulators  in  th<  deduction  ot  which  no  sup 

*  1  >ns  wore  ride  1,  the  effect  that  the  interference  at  receiver  input  •  < 

■  iker  than  t'.o  signal,  md  to  consider  t hat  in  I'.b.’Ji  h  is  \ariablt  .  In 

CI 

o  o'  ;  t  i".  ippiiont  t  hut  the  probability  ot  •  m  1  rust  *>e  creator  than  1:1 

t  1  si  .  •  in  .  ;  t  1  ra  1  .lu  1  s  1  hi;  s  s  t  or  . 

9-’  Combination  Mi  Itiplosed  C>'.  tens 

■  :  •'of)s '  j  1  S  s  s  t  o-  , 

r  t  rails,'  1  s-.  1  •;  ,  •  k  ress  t^s  ,  e  1  cl;  ot"  which  1  s  etuodid  the  CO.li  1  base 


.meet  in  t  e  • ;  !  ?  1  1 '  i  1  'ed  clvalina  1  must  ho,. 


roa  1 1  ;  at  1  otts  I  l 


1..  ‘his,  is  ill.  it  t  ans  art  utuills  ortho, innai.  1  .  or.brnat  ion  ort  hocotmi  1  mlti 
>  !  ■  1 1  r  n  oid'. 

I*  is  p  ssihl,  to  dot .  rr.  1  r.i  1  rir-in.il  conditiinai  t  requeno  b  md  ot  oich  a 

'Ctnl  bist  is  in  The  case  of  orthogonal  separated  systems  bv  equating  r  t 0  a 
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‘Here  we  have  in  ::ii  nd  an  excluding  "or"  since  if  both  interferenc..  component  s 
exceed  the  indicated  majtn  i  tiule ,  as  apparent  from  figure  9.9,  the  symbol  of  the 
third  message  will  be  received  coirectly. 
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\  s  already  noted  in  Section  1.0  lor'  reception  ot  Rl’l  signals  it  i  s  pus 
sib  If  to  usf  dec  t  si  i  hi  circuits  usual  for  optimal  incoherent  reeept  i  on  ,  for 
example ,  a  quail  rat  u  rr  firvuit  uitli  matched  filters  ami  finelopf  lift  fit  ori ,  a  ml 
othfrs.  Hu*  saiiu-  port. Him.  t0  \|Rp|.  Iluurifr,  here  other  ilffisiori  circuits 
art'  ptjssibli  in  which  separate  ilf  f  i  s  i  ons  an*  reached  for  1  iih  ssage  s  .  I  or 
example,  a  decision  f  iron  it  is  Miggested  in  [  I  1 )  which  i  s  based  on  tin-  algorithn 
shown  in  for  an\  mu  1 1  i  p  If  x  i  up  factor  on  foiulitioii  that  thf  (lra>  code  i  s 

llSf  il  . 

\  s  fail  easily  bf  sffii ,  whfii  tin-  lira)  foilf  is  1 1  <  t*  il  it  follow  from  >~l' 
tliat  thf  symbol  "0"  in  thf  first  message  o  recorded  i  1'  0  in  thf  second 

r’fss.ip  it  J  _  J  ,  in  thf  th:  ril  message  if  ~/2  •_  2 :  •  ~/2 ,  in  the 

fourth  message  it  -  J  I:  J.  ami  generally  in  thf  i-th  message  li 

a  "0"  is  I'oy;  i  stf  rfil  if  -  J1  '  .  In  othfr  words  ,  in  the  first 

message  "0"  is  registered  it  sin  0  ami  in  remaining  messages  if  fosfj1  “  :  )  U. 

Ibis  poiTuts  fonst  nift  l  r.g  the  ileeision  circuit  shown  in  ligure  9.11.  Ilu 
s  i  gnu  I  reft  ivoil  passes  through  t  ht*  I  liter  'll  matflu'il  with  a  segment  ot'  a  s  i  nu 
sold  with  a  frequency  of  „  am!  a  length  ot'  I.  \ t  reailout  instants  ili\isible  b\ 

I  the  s  i  m-  ami  cosine  components  ot'  thf  output  voltage  of  this  t'ilter  arc  divis¬ 
ible  hv  ami  B  .  This  voltage  is  shifted  in  phase  by  - / 2  and  is  multiplied 
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figure'  9.M.  Autoforu’l  Jt  ion  Decision  Circuit  (or 
Messages  in  an  MPPT  Cyste-'. 

Here  it  is  issiira'd  that 

In  (It,  rut  mention  is  r.uii  ;  .1  r  it  1  he.!  filter.  1  hr  re  tori  .  .1  ircuit  1  s  s«icre- 
t  t'd  !  her  uh  1  1  h  .  s  t  r  1  1  t  1 1  spe  il  1  :■  r  .  1  s  11  >!  op  t  1  r .1 1  . 


iso 


he  i  1  1  Jr. a  rut  ion  one  decision  circuit  lor  the  IiRl’i  (k  Jl  which  ''.is 
first  used  in  .m  Mi  1  s\sti‘i:i  [9J.  let  1  ^  0  correspond  to  symbols  00,  '  ,  •/„’ 

to  svnbt  Is  01,  to  sMiibols  11.  and  S/J  to  svmbols  10.  Mubst  i  tut  i  n  >■ 

.  *  I 

those  \  ,i  1  lies  of  in  (9,;.:.  I  ,  we  find  that  symbols  00  must  be  registered  if 

r.y.vn  '■  ifjrH> |  vjrn-A”jr,  \ 

symbo h  01  if 

--  -  fi‘„A", )  •  |.V„  I  *„  !  H’Ji'W. 

symbo  Is  ]  1  it' 

—  /f'n/f  %  )  >  |  A  „l{  n—HnA  n|. 

ir  1  :  jo  1  s  10  i  f 

v'n>|,v„.-r„  ‘  I 

It  ran  easily  be  -eon  from  these  i  nei|tia  I  i  t  i  es  than  in  tin  first  message 
symbol  "0"  must  be  registered  if 

/V„.r„  ;  />■  f<\A\  .i-„/r„>ii,  i y . > 

and  in  the  second  message  it 


A’, ,  .'V'„  !  /<„A'n  i  ty.j.M 

liie  quadrature  decision  ciruut  ■  shown  in  figure  9 .  1  J  [9]  which  needs  no 
further  explanation  is  constructed  on  the  basis  of  this  algorithm,  he  will  on  I > 
note  that  one  of  its  merits  is  that  the  it  union  device  must  "remember"  only  the 
magnitude  of  a  constant  vs  Itage  in  dntnutioi  from  tin  liel.a  lines  in  the  i.  :  : 
wuit  of  ligure  9,11  and  other  aut  hocorre  1  at  l  on  kii\uits  where  the  phase  of  ,i 
variable  voltage  is  remembered. 

he  will  begin  the  de  t  ermi  nat  i  on  ot  emu  p  rob  ab  i  1 1  t :  es  in  the  i  ,oe  of  n. 
coherent  reception  with  a  bid’!  system.  \  n  ev a  1  eat  I  on  ot  the  tital  probahilitv 
ot  error  p  for  this  s^  stem  was  obta  tied  in  (.1.111. 

Let  s\iiibo  1  s  00  be  transmitted  f\  difference  ir.  phase  .  t,  s\r,bo!>  I 

by  ,  -  j  1,  svr.bols  1  1  In  .  j  1.  ami  svmbols  ]  0  bs  ^  i.  i  lien  prill 

siple  can  be  representid  in  the  following  form:  symbol  "0“  in  the  tirst 

message  is  registered  if  cos  :  o  ,md  i  ;i  the  second  m.essagt  i!  'in  0. 

based  on  (9..r'0J  the  princi|  !e  for  registering  synbe  1  "0"  m  the  tirst  message 
can  be  written  as  follows; 


In  [9j  this  circuit  is  called  a  correlation  circuit. 
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figure  9.J4u  shows  the  dependence  of  p  .  on  v  ■  •  for  MI'P  1  and  1  i  guru 
9.14b  shows  thx'  dependence  of  p  on  (f^.-  f.fl  for  Ml  1  . 

In  MRI’I  systems  the  values  of  transmitted  differences  in  phases  are 
limited  by  the  magnitude  2".  In  the  case  of  k-fold  multiplexing  the  least  value 

oi  ,  cannot  be  greater  than  J  ^  Therefore,  max  p  .  increases 

rapidly  with  an  increase  in  the  multiplexing  factor.  The  values  of  max  p  ,, 

as  can  be  seen  f rom  figure  9.14a,  are  approximately  equal:  when  k  =  2,  0.~1; 
when  k  =  3,  0  92;  when  k  =  4,  0.98.  When  k  ■  1 ,  assuming  in  (9.66)  mat 
■  ,  ,-k+ 1  .  ,  ,  . 

-  =  2  ’  ,  we  can  easily  obtain 


m  ll  }ri  I 
r.  I 


(9.6S) 


The  rapid  increase  in  this  parameter  causes  a  sharp  drop  in  the  resistance  to 
interference  with  an  increase  in  the  multiplexing  factor. 
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t'  i  ■  ■  \  . .  •  w  .  t  h  i  L.  •  :  •  :  wh  i  . h  .  .  t  rt  1 1  r.  tv  ili.it  i  ot 

' 1  ■  : :  •  r  i  r , .  .  i  v  i r  r*.  ;  ■  :  .  .v  t  i  .i ti ■-  :■  i  ’ 4  >1  s  1  I  -  I  t  hr  ■■  ecnj.da  r\  v  oiK 

i :  ■.  -  . 1 1 1 •  ■  n •  i  . i !  !  ■•  ,  i>” !'  i  red  1 1  '  -a  *  o-  S  :  i '  ■  t  u h  :  1 .  i  r<  i  i  i  ik  i d<wl  the 

•  •  i :  rrihwul.iiK  v  s' ! t •  ■  s  t  s>.  !•!>■•;  . .  i  < •  r  :*«  t  i  <•»  «  r  !■  t  •  .  t  i  •  :  o  t’  i ■  'To  t  s  i  ,i  1  s, , 

!  ■■■  :n  ’iir  'ft  i  lul.irv  ••'.!■  1 1 1 1  r  t>hul,  t  hr  collected  s  i.'  i  s  .irr  iviorri’il  into 

i.:.;  i  •  ,c  it  r  !’  . i  .  .  t'  the  : 1  r  i  .  i  r  ••  .Ir  di  st  ri  hut  ed  ovi  r  their  tress  igos. 

\1 though  the  tltprry  of  interference -resi  stant.  codes  with  a  base  cf  in  . 
wlioro  r  is  a  simph  number  !  spot  i  t  i  ca  1  I  y  rt  di,  has  horn  rather  well  woil.nl  out  , 

the  eet  I’.i'.l  of  coding  |t  rose  i  i  I'n!  h  o'  put  found  wide  u  e  :  p.  •  r.io  t  i  ce .  vppuivnt  •;»  , 

t  he  romp  !o\i  ty  rf  t  i-clino  log  i  v  n  I  i  1 1  .•  .i  t  |  •  .n  is  net  testified  hv  the  small  ad 
\  ant.igi -s  wiiisli  o.iti  ho  fro:-  its  • .  i  . 


\  tint'd  and  ;:io  ro  pr.ict  i  a  I  retir'd  •  f  .  ,.h!i'ii;  is  used  for  m-jvi  rah  !r  and  quasi  - 
so;>  i  rah  !  t  sector-  md  h.a  bcti  g;\ei:  :  lie  aar.<-  i  f  paralh  1  coding.  It  amounts  to' 
■mb  !  n  i  ng  the  synii.ils  of  a!  t  ran.  ritted  i:k  •  ages  into  utio  code  >.  ombt  n.at  i  nit  and 
the  redundance  svmbole  .died  to  it  ire  t  rar.smi  l  Led  in  the  torn  of  additional  code 


riissages.  I  1 1  r  r.\a::.[-l>  ,  if  a  -.u  1 1  i  p  I  o\ed  systoi:  is  designed  for  the  t  ransmi  ss  i  on 
ut  seven  Message;  and  actual]'.'  only  four  are  transmitted,  instead  of  the  remaining 
throe  messages,  it  is  possible  to  transmit  check  symbol s  formed  in  accordance 
with  prwi  i  i  >  I  *s  t  J.oOj  and  t  •>  !'■  n.-.  a  systematic  code  (".•!  i  .  1  li  i  s  :  ••nr.i  i  •-  correc- 

'  ing  an  error  in  any  one  .d’  t  i;e  messages  or  detecting  simultaneous  errors  in  two 
::  ess ages  ,  no  matter  how  i'reuiii  ut  I tliev  or  air. 


Parallel  coiling  can  lu*  done  just  as  sjmpl>  as  ordinary  sequent  i  a  I  coding 
and  has  many  advantages.  With  parallel  coding  it  is  simpler  to  effect  entirety 
reception,  the  methods  of*  which  will  he  con-idered  in  the  following  chapter. 

In  .1  channel  with  selective  lading,  in  the  case  of  frequence  multiplexing, 
errors  in  different  messages  are  usual l>  less  •orrelated  than  errors  in  the  m- 
quential  symbols  of  one  message.  therefore,  interference-resistant  codes  whivh 
are  calculated  for  a  channel  without  memory  are  mure  effective  in  parallel 
coding  than  in  sequential  coding. 
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and  multiplexing  factor  for  the  principal  systems  considered.  It  was  assumed 
for  separable  systems  that  for  individual  signals  relative  phase  telegraphy  is 
used,  figure  9.15b  shows  for  the  same  systems  the  relationship  between  signal 
power  required  to  obtain  a  given  level  of  fidelity  (eharaet or i ted  by  the  average 

probability  of  error  in  a  message  p  ^  -  Id  *J  and  the  multiplexing  factor. 

It  is  very  clear  from  these  figures  that  systems  retaining  a  high  level  of  re¬ 
sistance  ti  interference,  when  multiplexing  factor  increases,  require  great 
widening  of  the  frequency  band  occupied  by  these  signals  and,  cn  the  other  hand, 
in  systems  retaining  a  given  frequency  band  the  required  power  rapidly  increases 
with  an  increase  in  the  factor. 


As  was  noted  in  our  chapter,  the  problem  of  multiplexing  a  channel  arises 
in  those  eases  when  the  carrying  capacity  of  the  channel  greatly  exceeds  the 
productivity  of  each  of  the  sources  of  messages  which  are  to  be  transmitted. 

In  the  simplest  case  let  each  source  emit  messages  which  are  encoded  by  a  se¬ 
quence  of  equiprobable  and  independent  binary  symbols  at  the  rate  of  v  per 
second,  let  the  channel  have  constant  parameters  and  the  passband  be  delimited 
by  the  value  i;  (or  it  may  pass  signals  with  a  frequency  band  not  exceeding  l:J  , 
let  there  be  i::  it  normal  white  noise  with  a  spectral  density  of  v  ,  and  let  the 
power  of  the  signal  at  channel  output  not  exceed  P.  This  channel  can  multiplex 
k  messages  if  the  following  inequality  is  met: 


A’e  <  /  lug. 


■r 
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19.701 


where  tin-  lett  sidt  repi esent  s  tlu  tot.il  }>  miJik  t  n  t  t  >  of  tin-  M'nru-v  .md  the 
right  ]'  art  the  carrying  i  .ip:u  1 1 1  ot  the  channel.  tins  i  niwiua  1 ;  t  v  can  1m-  ri 
written  as  loll ov s 


.i  i  b  ) 


figure  5-I&.  o)  DciimJcntc  Bi'ti.ccn  ••inlnjl  Possible  fre- 
guericy  Band  o  1  S'qn.ll  on  Mu  I  I  I  p  I  r  *  i  r-j  f  nc  t  O  r  ;  b)  Dependence 
in  the  ><bstfn(.f  of  r.ltlinq  on  Mu  I  t  1  p  !  ex  i  nq  factor  In  t  *'»•  Case 
When  p.  "  I  0  I,  Separable  O'  t  hoqond  I  system,  1  nj  i  v  i  du.1 1 

I 

PPT  sign.il,;  2,  Separable  ort*'Og0n0|  system,  individual 
slgn.ils;  3.  f'RPT  ;  fi ,  OfthoQon.il  MFT  systems;  5.  Mixed  system** 
frequency  mu  I  !  i  p  1  e»  i  nq  ..  1  i  h  combination  DRPT  signals 
( 1  'K  i  nep  lex"  type). 

I  lie  select  1  oil  ot  till  1  t  I  {  levin.;  iretlio.l  dt  pends  Tt.  .iiii  1  \  on  the  ratio  between 

••/  .  f. 

the  two  factors  on  the  left  ff>.  "II.  l  ev  example,  let  • 't  Ingi/  I  • 

i.e.,  the  high  carrying  capacity  of  the  channel  is  conditioned  mainly  In-  the 
wide  passband,  and  the  avail  able  signal  pmuT  is  not  great  .  I  h  i  s  occurs,  for 
exam)ile,  in  transmitting  telegraph  messages  over  tropospheric  radio  channels, 
over  channels  with  passive  relay  using  earth  satellites,  or  in  transmitting 
telemetric  messages  over  low-power  radio  channels  when  the  rated  speed  of  the 
transmitters  is  much  less  than  the  passband ,  eK  obviously,  in  this  case  we 
should  select  a  multiplexed  system  which  provides  for  a  h i uh  level  of  fidelity 
with  a  relatively  small  ratio  of  sipn.il  pimcr  to  noise  spectral  density,  if  only 
due  to  the  wide  band  ot'  frequencies  used.  In  principle  an  orthogonal  Ml  I  system 
or  any  'other  orthogonal  combination  system  is  such  a  system.  However,  it  should 
be  considered  that  with  a  large  multiplexing  factor,  designing  combination  svs- 
teins  is  technologically  different.  Therefore,  use  is  sometimes  made  under  these 
conditions  of  separable  or  mixed  multiplexing  systems  in  which  the  total  signal 
is  the  sum  of  several  signals,  each  of  which  carries  several  messages  and  is 
obtained  by  the  combination  method. 

In  the  other  extreme  case  !•••-•..  i  /  1  •  ,  •  ,  i.e.,  the  high  carrving 

l  *  ' 

capacity  is  conditioned  by  a  large  si gna I -t o-aoi se  ratio  and  the  passband  is 
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.1  signal  pas.->itn:  through  chant. i  1  u  i  *.  h  t  j-a>  •  !  and  T  ;  :  1  \  1 ;  -  ;  t  •  i  .  !  i  » 

complete  ly  charade:  i  -t  .  ced  t>\  its  .  ,  1 1 1 : .  >  te.Jcit  it  ; : .  T  •  r  .  il  ;  tiro  eqt:a  1  ■ 

i  Jl  I  \  It  .'illy  lull. ir.  ■  ;  c.ii a  1  s  .tv  '-i-r.t  in  'i,.  !:  a  .hat.r-cl.  ;  :  ;  -  ipraivit  tii.i 

Jl  cha  rac 1  i-r  t  res  the  taa.x  i  nun;  po->  -  ib  !•.  r.t  t  •  't  tj.iip-..  s,.n.  It  ea>  .  h  hi 

seen  that  this  rate  dues  not  >.hc.,;e  i!  use  i  trade  !  t'reijin  :;e\  :  u  1 1  l  ;•  1  e  \ ;  n}; 


a  I  nut:;  ;>u--ih!i  rat-  't  tiaiis-,.  s.  n.  It  at.  eas.lt  hi 
s  not  «.lie.,;e  ;!  its*'  i  trade  :  freque  nc\  :  u  1 1  i  ;■  1  e  \ ;  ny 
after  di  viili  n<  bund  !  mti  1.  i-..  .il  parts  since  in  -.  ir1  pait  tt.i  \v.(u;  st  i  a  r  n  .  I 
capacity  hi  II  hi-  equal  to  Jl  I.  It  is  pesstbli  tr  '  \au!  tie-  \.;u;st  rate  i 
refraining  t’roin  binary  ceiling,  .speci  f  ica!  ly  h>  us  i  nr.  a  aC,h  ;  nut  i  "t:  ran  1 1  i  p  it  \  ;  n, 
system. 

Until  recently  tin-  opinion  imis  hide  I  y  held  that  ru  1 1  i  n  1  e  \  i  r. 'lieu  Id  he 


applied  only  to  channel  pus  a-ssini;  at.  excess  '.yquist  v  irrnn,;  s.q>i,ity.  Iht 
t'ore.  tlie  excess  ill  tin-  sirnil  to-noise  rat:  usual  h.  remained  unused.  nr.  !c 


interference  which  » an  be  » >  f  ed  <  r»  I  \  h»  ws;n»;  Itrpi  protective  in!i  r\  .ih 

in  !  ri'ijiic!u\  ,  b »  i.hm  int  »p  j>  r  o  • » <•  rthocomilifx  .1 f  t  f  <  j  r  1  *  <  of 


\  \*  X  U  M* 

S  t  he  !  f  eque  ru  1  t’  a!  d  . 

1  n 

tne  •  <  .  or.J  ^rowp  are  li.  lu.fi.l 

pruu  1; 

illi  as  ru  h.  t  ifftii.i  s 

add  re  s  1  s  1  c  f  >■?  s 

jl"j  It*  t  f;i  "os!  part  t'uv  .111  him-.!  for  !  Ju  T  t  .him:  i  v  s  1  mi  !  continuous 

!»;<•*•  t  'if  in  r  :  ji ,  1  p  I »  t  he  v  »  .»n  be  u s<-d  »u>  % «  s «■  t  u  1  1  v  fur  **u  1 !  1  ;>  1  e  <  1  1 

channel  v. .  f  n  Ji  \  ,  r>  Ii  r  'm.i;i'i  . s  .  in  I  1  »i..  .  >  add  r>  •>  s  n  '  '  rrv  .irmm!  !u  d  1  v  1  x  • 

i!>lc  <n!c"i  in  which  .1  message  transmitted  to  .1  certain  addressee  frcciplcnt) 

1  v  h.i  r  .1  i  t  i  ;  t  d  l«»  its  own  signal  f  i  1 1 1  ;  it  1  on  I  ec  «•  1  v  <•  r *  o !  «•  w  h  1  ,!.!  r<  ■> 

.1  f\  r  at  i  hed  11  •  o  rt.nn  h:im‘  with  flu-  iiMn-oi  rh  n  .•  I  1  ;at  1  »>n  •  t  the  signal 

iin!,  f  i’  tin-  1  i'i  11!  pmiMi  ,  do  not  react  t<  other  ri  .» J 1  2. it  :  "iis  . 

I!  c  in  h  1  ns  ter  were  s  v  n,  h  I  onou  •.  ,  it  would  h<  possible  to  rale  ail 
re  a  1  1  :  at  1  ons  orthogonal  and  to  corple’elv  eliminate  transient  interference. 

Ihe  point  in  asms;  an  .iMiuhroiHm'.  s\s*er  is  that  e  idi  source  .  in  inj’iit  its 
rcss.ijte  into  the  channel  regardless  of  other  sources.  In  this  process  the 
sources,  nist  as  the  recipients,  can  he  phvsic.illv  United  jjj  different  places 
ind  v  m  use  m  r.  dio  co-r.uni  c  at  1  on  the  safe  f  re.ju<  nev  hand  or  the  sar-e  r  1 J ;  < 
rein  1  tor  example,  one  located  on  in  artificial  eilth  sa'ellltei. 

In  principle  it  would  !e  possible  const  nut  sudi  m  as .  tu  h  renous 
s  \  s  f  r  ui  the  1  i'  1  s  t  freuuer.vi  ru  1 1  1  p  U  x  i  n»;  bv  1  s  s  1  cn  1  ".i:  a  frei|iieiu\  hand  to 
e.uh  addressee,  to  which  the  addin  ssee's  rni'iier  would  he  t  uned .  Ihe*'  each 

mo'  would  ha\c  t  tune  its  transmitter  to  the  hard  assigned  ti  its  addressee  . 
In  ■  "ciio  radio  cor  run  1  c  it  1  on  in  the  shortwave  1  an,:'  .  which  is  not  usuilh 

licit  i'd  is  1  r  .  !  t  1  ;•  1  e  *  1  n sutrr  hut  r ,  1  e  is  an  1  hit  ess  s  \  s  t  e-  ,  1  s  e  r  c  an  1  :  ed 

. :  '  h  ;  s  wo.  1  he  ;  > r~  1 1 1  r  t  s  1  tiu  |  *•,  1 1 1  ;  1 1 :  >n s  -ism*:  >  s«  ,  a  1  1 1  d  t  reuuoncx 

!  ;  "  •  1 i  1  »  1  '  1  ;  r,  ill  lilt,  of  si  'll"'  w!.  1  >  !.  ha',  c  heel'  Hared  I  I  s  c  fe  f  i  -old  I’i  s 

sisters.  lad;  ■  1  cn  1 1  re  ilic.it  ion  mounts  to  1  sequence  >1  sen  r.il  radi  impulses 
witl  a  ditfiietit  !  re.pn  lies  fillet.  i  hi  addresses  an  distinguished  as  inter’.  .1  Is 
t  t  tru  between  impulses  as  well  as  (u  the  Ireipietuies  of  the  t  liters.  Iliis 

pennits  a  very  simple  device  tor  •electing  an  addressee.  keeeption  o  accom- 

pi  1  shed  usuid  .1  nonlinear  device  containing;  .1  ih  lav  Inn  and  a  coincidence  cir¬ 
cuit  and  reacting  only  to  a  certain  seq.ieiio  ot  impulses.  It'  only  a  leu  sources 
opp-ate  at  the  sar.e  tire,  each  receiver  receives  onlv  the  signals  addressed  to 
it.  irosstall  interference,  which  is  called  occurrence  of  "false  addresses" 
occui  -  when  n.itii  sources  frmsnit  hecause  ot  the  random  cotr.h  1  nat  i  on  !  impulses 
whidi  tie  tratisriited  h\  the  ditto  rent  sources. 

■iich  .1  sister  perrits  orcan  1  ;  1  nc  radio  cormur,  1  cat  1  on  with  the  s.ire  con  - 

v  en  :  I'fu  tir  .  r  n  sj'on.lr  n  t  s  ,s  is  1  is  h.i  I  1 1  pro\  1  dud  tor  in  .mton.it  u  >  1 1 . 1 1 1  n  c 

in  1  on  -  d  1  s  t  ance  telephonic  cor.r.un  1 .  at  1  on  . 

i.  (  kee  Section  ;>  .  In  1  multiplexed  connun  1  cat  1  on  channel  the  total 
number  of  messages  for  which  a  channel  is  designed  is  far  Iron  always  used, 
lhis  is  especially  character!  st  1  c  of  channels  which,  are  multiplexed  hy  continuous 
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Ibis  same  idea  ub  statistu.il  r.ul  t  :ple\in>t  is  used  in  asynchronous 
•  ishlress  systems  nhtch  non  inent  i  >nesl  in  \nte  J.  Ihe  nonlinear  metliosl  of  selec¬ 
tion  l in  a  s ui  iK  i dense  sircuit  pfiuides  in  them,  for  all  practical  purposes, 
for  an  absence  ol  crosstall  i  nti  rt  eretne  nht  n  the  number  of  simultaneously 
operating  transmitters  remains  In  ion  i  cert  un  permissible  level.  Kith  an  in 
crease  in  this  numbei  the  crosstali,  intorforence  lapisllv  increases  and  the  system, 
becomes  inoperable. 
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Ilu1  j  re,  litre  «.  I-.  .t{  t  e  r  *  h.ne  !•  ilth  ,!'..  oil'  v»  i  t ri  ~i:.t  b\  r  Ir-i  r!  re ,  ■  : 
t  1 1  >71 .  I'hapt  e  r<  III  through  I  v  ire  devoted  to  problems  nri'h  iiii:  ‘  <  t  ,i  -v*  t  <!< 
cisi  c'.n  -  \-  <  t  en ;  the  st-^'iul  dt  ..  i  *  t  on  s\  x  ?  or  was  examined  r.nnh  in  ih  ip'ei  i  I  . 
Nearly  all  rite  existing  rece 1  \  i  ne  unit1*  in  .klinl  use  are  basic!  >  n  element 
by-element  reception,  as  the\  are  com  s  i  tier  ab  I  \  simpler  to  reali.v  than  tin  sc 
basetl  i'll  entirety  reception.  intiretx  re.M  t  .  on  ,  as  was  mentioned  in  i  haptt  i  I, 
has  n,  ml\  ant  aces  over  o  lament -b\  -  e  len  ent  lvc-pti  ,:i  in  non  ;  edimdancx  encodi  nr. . 
Ihese  tacts  explain  the  attentiin  which  |s  >rJ.narv  devoted  to  e  leinent -by  - 
element  reception. 

I.lement -by-e  lenent  reception,  however,  cannot  i>e  the  optimum  reception 
method  if  redundancy  is  used  in  encoding,  e\cn  if  ttu  first  avid  second  decision 
systems  are  optimal  (e.e.,  in  the  sense  of  the  ideal  rl'server)  .  I  h  l  s  can  easily 
be  understood  from  the  following  discussion. 


fhis  result  will  be  proved  in  passing  in  Section  10. a. 
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di.inru'l  vlhir.iv-tt  :  ir-tiw,  .is  well  .is  the  reception  me t Iuk’.s  irt-ntioneti  which  occupy 
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10.2.  Entirety  Reception  with  Fully  Known  Signal  and  Fluctuation  Nc.ise 
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The  d  i  He  ronces  z  ft)  -  z^  ■  (t )  may  assume  only  two  values:  r.jft')  -  or 

z^(t.)  -  Let  us  denote  the  first  of  these  by  z.(t),  then  the  seeond  by 

-  z  .  1 1 ) . 

Let  us  introduce  the  further  notation: 
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l'his  representation  of  the  decision  principle  is  convenient  in  that  both 
sides  of  the  inequality  contain  the  same  integrals  which  for  further  generali¬ 
zations  mav  be  convenientlv  denoted  hv 
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and  different  among  themselves  only  by  the  .  coefficient. 

In  this  notation  inequality  MO. “I  assumes  the  following  simple  form: 


MO.  Sai 


I  he  re  fore  the  decision  system  'figure  10.1.)  corresponding  to  the  principle 
of  expression  (.10.  7  J  ,  contains  only  the  som  ce  ol'  the  periodically  repealing 
signal  z .  (M  J  of  period  1  which  is  multiplied  with  the  incoming  signal  z’(t). 

1  hoi  i'  product  is  integrated  over  intervals  of  T.  as  occurred  in  element -by - 
element  reception.  At  moments  divisible  by  i  the  values  ol'  c.  come  from  the 

output  of  the  integrator  and  are  fed  in  parallel  to  multipliers-,  to  each  of 

which  proceeds  the  sequence  of  discrete  values  .- .  (q  -  1  )  stored  in  the 

i  q 

memory  unit.  It  is  easily  seen  that  every  such  sequence  is  nothing  else  by  the 
q-th  code  combination,  in  which  the  "0”  symbols  are  replaced  by  The  pro¬ 

ducts  taken  from  these  multipliers  are  integrated  fsummated)  over  time  nT 
and  go  to  the  comparator,  which  chooses  the  largest  of  them  and  determines  from 
it  the  received  message  letter. 

The  decision  principles  derived  may  also  be  applied  to  the  case  of  the 
channel  with  variable  parameters  if  the  parameters  change  slowly  as  compared 
to  the  length  of  the  code  combination  and  may  be  predicted  with  sufficient 
accuracy. 

_ _ _  -  ■  /  , — . - 

'These  multipliers  function  essentially  as  polarity  switches. 


Figure  10. I  .  Decision  System  in  Coherent  Entirety 
Recept i on . 

(.'a  leu  1  a  t  i  on  of  the  probability  that  inequality  (JO.  7)  will  not  be  In  1  - 
filled,  i.e.,  that  a  sign  will  be  incorrectly  received,  encounters  the  same 
obstacle*  in  entirety  reception  as  were  mentioned  in  Chapter  III  for  the  case 
of  III  2. 

Mi  some  particular  cases  this  probability  may  be  expressed  as  integrals 
which  can  be  numerically  calculated,  further  on  we  will  give  an  evaluation  of 
this  probability  which  is  not  a  very  accurate  one  but  allows  for  a  comparison 
between  entirety  and  element-by-element  recv.pt  ion. 

10.3.  Incoherent  Entirety  Reception 

If  the  initial  phase  of  a  transmitted  signal  is  unknown,  incoherent  recep¬ 
tion  must  be  employed.  Here  two  cases  must  be  examined  separately. 

aj  The  initial  phase  of  the  signal  corresponding  to  the  code  combination  is 
random  and  unknown,  but  it  is  maintained  during  reception  of  the  whole  code 
combination.  This  case  is  no  different  from  e  lenient -bv-e  lenient  incoherent  re¬ 
ception,  if  "element"  is  understood  to  mean  the  whole  signal  corresponding  to 
the  code  combination.  The  decision  principle  of  (-I.2S)  is  obviously  optimum 
for  this  case,  for  act i ve- i nterva 1  signals  this  principle  is  simplified  and 
reduces  to  expression  (.*5.30).  The  meaning  of  V  must,  of  course,  be 


where  z  (t)  (q  =  ),...,  I  is  the  signal  corresponding  to  the  whole  code  combi¬ 
nation  of  letters  x  and  z  ( t. )  is  a  function  conjugate  with  z  ft). 

q  q  '  m 

Since  the  values  of  V  are  formed  hv  adding  the  corresponding  values  for 

q 

the  elements  of  the  incoming  code  combination  with  allowance  made  for  the  con¬ 
stancy  of  the  initial  phase,  the  reception  method  based  on  comparison  of  the 
values  of  JO. 9)  may  be  called  the  method  of  coherent  cumulation.  The  decision 
system  for  the  method  of  coherent  cumulation  is  very  complex,  inasmuch  as  it 
must  contain  21  generators  of  signals  z  (t)  and  z  (tl. 
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By  regard  i  ng  ,  h  in  these  equalities  as  a  pa  rami' t  or  wo  may  plot  t  ho  ilopon- 
ilonoo  of  P  on  p  (curve  in  Figure  10.(0. 

l;or  incolioront  rocoption  with  colic  rent  cumulation  wo  assume  t  ho  signals 
corresponding  to  0  and  1  to  bo  orthogonal  in  the  intensified  sense  and  obtain 


!  /  h- 


(10.30.) 


Under  this  condition  the  full  signals  correspond  i  ng  to  the  combinations 
000  and  111  are  also  mutually  orthogona  1  ,  but  have  triple  length.  Therefore 


■1  j'  /,:)' 


whence 


U  u . i  j 


no.3: 


i  cu r\  e  b  ,  I  i  gore  1 0 . 0  l  . 

I'e  will  study  the  case  of  incoherent  cumulation  using  the  example  of  a 
channel  with  Rayleigh  fading  and  assume  that  the  code  combination  elements  are 
adequately  spaced  for  complete  decorre lat i on .  In  this  case  P  may  be  di lined 
as  the  probability  of  error  in  triplex  time-variant  reception.  from  (C.3S| 
we  find 


r*  f'V  :  r>  ',(!  /•)•  |  i  ,-1  iv 


( 10.33: 


(curve  c,  Figure  10. 6 J 


Inequality  (10.1SJ  is  corroborated  in  all  three  cases ,  as  the  figure  shows. 

Example  2.  Let  us  figure  P,  and  P,  and  find  an  estimate  for  P„  in  Hamming 

I  I  o' 

code  (0.5)  which  can  detect  any  odd  number  of  errors  in  a  six-symbol  combination 

for  this  code  d  .  2  and  m  -  C~  =  15  In  element-bv-element  reception,  as 

m  in 

is  easilv  ascertained  (assuming  p  1  , 


l’  i  (!  /-,•  _•■,-. 

1  v’ ||  n'  .  I ’ / *  1 1  n  .  i 


0  0.51) 


where  p  is  the  error  probability  which  in  incoherent  reception  and  with  no 
fa  1 i ng  i s 


I  f  h'  \ 

‘V  2  J‘ 


(10.55) 


Probability  pj  in  a  coherent  cumulation  system  may  be  defined  as  the  proba¬ 
bility  of  erroneous  reception  of  an  element  of  double  length: 


i 

Pj  .,  i.\;i(  V) 


(10.35a) 


I.et  us  use  (10.  IS)  to  bound  I’, 
and  (10.J7)  to  bound  it  from  above. 


from  below  according  to  which  I’, 
Then 


l‘i  «7'd  7 ..r«i- x;»  (  !P).  (10.3b) 

1 

Figure  10.7  shows  the  dependence  of  1*  and  P^  on  h“,  figured  by  substituting 

expression  (10.33)  into  expression  (10.34),  as  well  as  the  area  of  possible 
values  of  P.  derived  by  means  of  tire  indicated  estimate. 


Figure  10.7-  Probability  of  Incorrect  Code 
Combination  Reception  with  (6,  5)  Code  in  Absence 
of  Fading. 


In  slow  Rayleigh  fading  P  and  P^  are  figured  by  averaging  expression  (10.34) 

with  respect  to  h.  Here  it  is  assumed  that  h  hardly  manages  to  change  through¬ 
out  the  code  combination  reception.  In  the  case  where  )v  (the  mathematical  ex- 

sJ 

pectation  of  the  value  of  lv  )  is  large  enough  the  following  approximations  are 
defined: 


l  or, 


(10.37) 


In  the  given  case  P ^  and  P (  are  so  close  to  each  other  that  they  give  an 
adequately  exact  estimate  of  P_  in  confirmitv  with  expression  (10.18). 

If  measures  are  taken  in  a  channel  with  Rayleigh  fading  to  decorrelate 
errors,  and  the  h  values  for  the  signal  elements  may  be  considered  independent, 
then  in  accord  with  expression  (5.17a) 

_ 1 

P  '  ^i  (10.38) 

In  this  case  entirety  reception  may  be  accomplished  by  the  incoherent 
cumulation  method  and  the  value  of  p^  is  defined  as  the  probability  of  error  in 

duplex  reception  (see  (6.37)): 
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Figure  1C. 8.  Probability  of  Incorrect  Code  Combination 

Reception  with  (6,5)  Code  in  Rayleigh  Fading:  - , 

Slow  lading  without  decorrelation;  - ,  Fading  v.ith 

error  decorrelation. 


By  substituting  expression  MO. ah)  in  e>  p  ross  i  '>n  (JO. 31  wo  deter,  ;iine  tlie 
relationships  of  P  and  P  to  h.  To  bound  P.  from  above  we  must  vibst  i  t  lit  e  e.\ 


press i on 

(10. 7<lJ )  in  expression  ( 

|  o. 

j  7 »  . 

1  i  g 

11 IV 

1 0 .  s 

shows  tile  1 

•<  suits  fo 

r  .  i 

eh anne ! 

with  Rayleigh 

fading.  1 

n  a 

ilia  lyr. 

1  ng 

them 

.  i  t 

should  be  r 

lent  i  oned 

t  hot 

error  de 

correlation  is 

a  necessary 

coin!  i  t i on 

for 

e  tie 

•ct 

ivcly  usi 

ng  tip'  re 

vlun- 

laney  ef 

a  given  code 

in  both  o 1 

eii'.ent  -by 

■  e  1  e 

i:k  nt 

and 

entirety  re 

■cepl  i  111!  . 

1  \  a 

luations  of  til 

e  re  1 i ab  i  1 

i  ty 

■  of  e 

lit  i  r 

el  y 

recep 

't  i 

on  l"or  ot 

In  r  .  ^  de< 

i:;av 

also  be 

de  r  i  veil  i  n  si  m  i  I  ar  fash  i 

OP.  . 

10.6.  Reception  Based 

on  the  Most 

Pel ioble 

Synb 

o  1  s  u  n  j 

Wagner  ,*■ 

le  t  Bod 

file 

method  of  roe 

option  las 

id 

Oil  tit 

l  n:os  t  »* 

1  i  al 

i ». 

symbols 

proj'os  d 

j  v 

Bo  rod i n 

[bj  occupies  an  interned 

i  at 

e  pe> 

it:. 

ii  iv 

f  lur;; 

t 

he’  e|,  :i 

;t  l'V  -e  lor, 

on  t 

and  ent  i 

rely  methods  n 

f  reception. 

1  t  S 

1 

•'  1  s 

that 

i 

r  any  cod 

Ii  combina 

t  i  •  m 

Id  -  - 1  1 

symbols,  and 

in  soir.i*  c:\ 

SC*!* 

even 

fP  1  M ' 

v  ,  r.’ 

.iv  Iv 

o 

rased  and 

the  trail 

m  i  n 

m it  ted  1 

e  t  t e  r  ivcogn i c 

0(1  (tk'Ci’Ji’ 

■  !» 

from 

:  lu* 

iv  r.  m 

i  n  i  r.. 

vmbo  1  s  . 

1  i:. eunuch 

as  any 

pa i r  of 

code  combinations  has  at 

!  v 

ast  d 

i  n 

1  (KM 

t  i  un:» 

where  svm1' 

O  1  a  do.  Hot 

agree,  no  less  than  d 

svmbels 

1  P 

i 

st  1 '  e 

(MM 

'•Oil 

to  mate 

this  p.ii 

r  i  ml  i  s  t  i 

ii- 

gu  i shab 1 

1  '  . 

1  1  • 

Let 

the  first  ;  v 

is  ion  system. 

the 

.mi:k 

( >no 

i 

V. 

e  1  eilien  t  -  P 

i  -e  1  el-. ell  I 

ri-  - 

cept i on , 

determine  the 

a  posteri 

o  r  i 

prob 

il»  i  1 

i  t  i  v 

s  o  r 

th 

e  symbols 

old  male 

tine 

p  re  I  i  tti  i  n 

ary  decision  t 

hat  a  svmh 

i;  1 

hav  i  r. 

g  the  gr 

i'.i!  os 

t 

a  posteri 

,ri  p  rub  a 

'  i  lit;- 

has  been 

t  ran. sm i tied. 

ihe  regen 

e  rated  c 

oi!o 

e  omh 

i  irit  i 

OP. 

del-  i  ved 

i  1  1'  l  s  i, 

a\ 

goes  to 

the  second  dec 

i  s  i  ,.,n  syst 

, 

but  , 

:  n 

i'l)!l  t 

im  n 

to 

i  1  eise  at 

in'  -e  !  er;en 

t 

recept i on  ,  i  n  format  i  on 

about  the 

a 

pcs  I  e 

r i  mi* 

i  pr 

ol'.'li-  1 

1  i 

t  y  O  1  e  \  1 

ry  regene 

r  ,t  ed 

symbol  i 

s  a  1 S  u  fed  t o 

the  second 

de 

vision  sy 

1  on. 

i  i  i gu r 

.  10.9  . 

l'uring  d 

ei'dini;  1 

t  is  just  the 

symbols  wli 

l  c!i 

have 

;  lie 

s;  rc 

:  1 1  e  s  t 

a 

post v r i o 

ri  pro!  . ib 

i  1  i  t  i  • 

("most  r 

e 1 i ab i e" i  that 

1  V<‘  t  ,l!  en 

into  co 

ns  id 

<  ;  . .  [ 

i ,  n  i 

n 

tlv  nnr.Jv 

i  win  cl;  i 

■i 

This  number 


needed  to  distinguish  one  permissible  eomh  i  nnt  i  on  from  another. 
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Ihis  met  no  I  of  reception  must  provide  higher  reliability  than  element-by¬ 
element  reception  because  it  uses  ; n format i  tut  about  the  a  posteriori  proba¬ 
bilities  of  the  regenerated  symbols  which  is  lost  in  element -bv-element  re¬ 
ception.  .'.ever  the  1  ess ,  it  must  be  in  principle  be  inferior  to  entirety  re¬ 
ception  in  fidelity  be  juse  ;hi  i  n  l’i>  rm.it  i  i'll  about  the  hast  reliability  symbols 
is  fit  re  completely  lost.  It  may  le  said  tha'  reception  with  respect  to  the 
most  reliable  sy;:.be!>  i  -  to  entirety  re, option  a-  diversity  reception  us  ini',  a 
selection  method  is  to  d:\er-it'  ret  option  according  to  an  optimum  addition 
me*  hod . 
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reception  will  be  a  detected  error,  but  reception  according  to  most  reliable 
symbols  will  give  a  correct  Jesuit  only  in  case  the  erroneously  received 
symbol  is  least  reliable,  i.e., 

ki! ^ (‘  (10.40) 

It  is  easy  to  show  that  only  when  (10.40)  is  fulfilled  does  entirety 
reception  also  provide  correct  decoding.  In  fact,  in  that  case 

P  r c,  i 

for  anv  i  ^  i  ,  while  c.  •  C  and  !.  .  c.  .  c.  .  if,  however,  expression 

1  r  1  i  r  l  l  r  l  ' 

(10.40)  is  not  fulfilled,  then  there  is  some  k-th  symbol  for  which  1 c ,  c. 

at  all  values  of  i  =  k.  Then 
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to  some  letter 
and  k-th  symbol 
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.  Hence,  there  is  a  code  combination  which 
differs  from  the  transmitted  combination  only 
for  which 


P,  ir j  I  ir'- '  ’d. 


This  reasoning  shows  that  in  the  case  of  fluctuation  noise  and  code  (n,  n-li 

entirety  reception  and  reception  with  respect  to  most  reliable  symbols  are 

equivalent  in  fidelity.  The  same  situation  is  also  true  for  binary  codes 

<•  i  th  a  uniform  weight.  Work  [a]  gives  proof  of  this.  It  would,  however,  be 

incorrect  to  generalize  this  conclusion  to  other  codes  or  even  to  the  class  of 

codes  whose  d  .  =2. 

m  l  n 

Another  receiving  method  which  occupies  middle  ground  between  element-by- 
el  emer.t  and  entirety  reception  is  called  the  Wagner  method  [4],  This  method 
is  designed  only  for  binarv  codes  with  even  d  .  .  This  tvpe  of  code  in  el<*ment- 

bv-elemcnt  reception  allows  the  correction  of  ffd  .  /  2  A  - 1 1  errors  and,  in  addition, 

min  1 

error  detection  if  the  number  of  erroneous lv  received  elements  is  d  .  /2. 

m  l  n 

The  Wagner  system,  like  that  in  figure  10.9,  feeds  the  sequence  of  regene¬ 
rated  symbols  to  the  second  decision  system,  as  well  as  the  information  about 
their  a  posteriori  probabilities.  This  information,  however  is  used  only  in 
case  element -by-element  decoding  by  the  means  of  parity  checking  indicates 
d  j  /2  errors.  In  this  case  the  least  reliable  symbol  is  changed  to  its  oppo¬ 
site  and,  if  it  actual ly  was  incorrect,  the  number  of  errors  is  reduced  to 
(dmin/2)-l.  These  other  mistakes  may  be  eliminated  by  parity-checks. 

from  the  above  it  is  evident  that  Wagner's  method  makes  less  use  of  the 
information  about  a  posteriori  probabilities  than  does  Borodin's  method 
(reception  based  on  the  most  reliable  symbols).  Borodin's  method  allows 


T *r 


the  correction  errors  no  more  than  d  •!  in  lumber  on  condition  th.it  the  11 

ni  i  n 

correctly  received  symbols  have  lower  .1  posteriori  probabilities  than  the  .01 
rcctlv  received  symbols,  whereas  h.igner'*;  method  permits  the  lOTi-ct  ion  ot 
on  ly  J  J  errors  it  a  symbol  having  the  least  a  posteriori  probability  enters 

into  the  number  ot'  incorrectly  received  sinbols. 

In  the  particular  case  ol  In,  n-li  aides  tor  win  ill  J  J  the  h.irnei 

1  u\  1  n 

method  is  not  essentially  el  1  f ferent  I'ror  Borodin's  me  thou  uhuii  ,  as  we  hast 

seen ,  in  this  case  provides  the  same  reliability  as  does  entire!'  icicpti  i  . 

It  should  be  note'll  that  Borodin's  method  i-  applieable  to  >  odes  ot  am  base  , 

whereas  banner's  method  is  designed  only  tor  binary  codes. 

10.7.  Suboptimal  Entirety  Reception  for  Codes  Permitting  Majority  Decoding 

In  e  lenient -by-e  J ement  reception  based  on  the  criterion  ot  maximal  1  i  k  <  li 
hood  a  symbol  having  the  greatest  likelihood  function  is  determined  from  each 
value  of  c.  obtained  as  a  result  of  demodulation.  In  optimal  entirety  recep¬ 
tion  likelihood  functions  are  determined  for  all  permissible  «.ode  combinations 
for  the  entire  aggregate  of  random  values  ol  c..  Ihis  leads  to  a  need  1 1’  sort 

a  large  number  of  inequalities  of  the  MO.R  .J  tvpe  and  this  le  ids  to  the  com¬ 
plexity  found  in  technological  realization  of  ontnety  receptioi  . 

Let  y.  (s  -  l,...,kj  be  the  information  symbol  of  a  systematic  in,  k) 
code.  In  e  1  ement -by -e lenient  reception  it  is  decided  that  y  0  if 

U-  f,  .  I  0,  0,  1  f<  ,1  t>,  I)  110.41) 

In  optimal  entirety  reception  the  decision  to  record  letter  x  (i.e..  the  de- 

c  i  s  i  on  about  the  entire  aggregate-  of  information  symbols  at  a  comb  1  nut  1  on  1  . 
i  s  made  i f 


f 0 r  all  q  7  r , 

Naturally  thought  arises  about  the  possibility  of  constructing  reception 
principles  for  which  the  likelihood  function  is  determined  tor  each  information 
symbol  separately  but,  in  distinction  from  e lenient -by - e 1 ement  reception,  on 

the  basis  of  an  ana  1  vs i s  of  all  values  of  c..  In  this  process  the  decision 

1 

that  v  =  0  must  be  reached  if 

.  r„  [  11,  0(  |  I)  (1C  .  4x1 

But  the  values  of  Cj . c  depend  not  only  on  symbol  y.  but  on  all  remaining 

information  svmbols  v  of  a  transmitted  code  combination.  Here  onlv  information 
.  .  s 

symbols  are  considered  inasmuch  as  the  check  symbols  are  determined  by  them  un¬ 
ambiguously.  If  the  a  priori  probabilities  of  information  symbols  are  known. 


o  J(> 
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Jiauad  w-A.uk 


*  i  .}u  r  e  1  Q  .  I  U  .  £  ompa  r  i  ,of  o  ■  **c  t  f'e  ds  'or  h’t  <•  i  .  i  -<; 

Signal*  Using  '  (7.  3)  Code.  I,  {I* — •c'- !  •  t> .  •  <•  le~e<  -t 
reception  .-.itn  frier  correction,  .  W,irjn(-r  '((Ihv)  , 

},  Borodin  r“e  l  hod  ,  ••  ,  deception  according  {  i  <  r  1  r<  - 
ciplo  <  J  0  *•  6  >  .  5.  Optical  •  r  |  ■  r  « ■  t  -»  reception. 

Condition-,  Under  i  cn  Use  of  be  dco'dan.  £»o<".  is  A  Jv  i  s  ab  li 


■  I  i  s :  I 


;  r  v  :  i  isc  li 
Thi  I  oil'  ,  t! 


I  he  llitriductl  'll  of  To  hitulan.  v  in  -ess.i,;r  Si'.  l!  .  o.U  (  .1  s  i  -  i  s  ,;i\ef 

males  it  ncve*!>arv  either  to  lengthen  The  tin  .a  1  1  «j  v  •»  t  o  .*  T  !m,  it  Tl 

f,  I  %  on  r.ess.ino  r  to  .shorter:  signal  e !  erer.t  length..  In  eitl.ir  .  a  f  hi  n  soi|M 

vim  IJ  t’e  sent  m  the  same  time  tv  "e.itis  t  .t  non  - 1  edot'dan.  \  .  .n.i  T  *  < 

length  of  the  el-ment  v  o  r  re  spend  i  nc  !  v  in. reused. 

In  Ron;  t  cases  dec  rc  .is  ini;  the  elenent  length  lead-  ;r  .in  in.  is  .im  in  Thi 
probab  i  I  i  ty  o?  erior.  Ihus.  i  >:  example,  in  t  In.  tuut  1  or,  muse  Tins  in,  iv.io 
error  probability  is  .  .iwmsI  1  v  Th<  vie.  reuse  in  sipra!  pooer.  ur.i  in  , impel 
nurse,  .ilso  bv  expand  i  my  thi  tri.puen.i  h  and  unuprisi  I  the  m  ,tt  i  .  Ihet  ef  ri 
the  probability  o!  erroneous  i  ie-ent  pm  pt  inn  is  udm.irilv  ,  le.itri  w  i  t  h  .r 

redundancy  eode  than  with  a  ...  !■  without  r  ■  dutulun.  v  .  It  This  ;  r . .  ri  ec  in  trt 

p  i a  h.itu  1 1 1  v  is  not  earuelle,!  h\  the  .urn  .  :  nn;  .  .ip.it  i  !  1 1  \  !  Thi  v  o.ie  ,  th< 

introduction  of  redund.uu  v  does  n  t  raise  i.-.iptioti  tidili*.,  hut  l.wers  it. 

I  he  question  here  arises  is  to  wli.it  conditions  rust  he  eii  is|  u.l  is  i  n-dun 
danev  code  lor  its  use  to  in.ihle  te.epT.on  tidelitv  to  he  in.sri.ise>!  as  ciTp.iri 
to  non  -  redtind  incv  en.odinp  with  the  s.i-.  n  ...i^e  t  t  .msr  t  ss  ,  .n.  pt  m  od  m-'  th.e 
sane  signal  power. 

Ihe  answer  to  this  question  depends  oi  the  .hannel  char.iv  t  e  r  i  st  i .  s  and 
the  svster  of  signals  employed.  !h<  -ore  sharp  Is  erroi  prohub:  lit\  rises  i 
an  elor.cnt  is  shortened,  the  Ren  ditlnult  it  is  to  .  unc  1  this  me  sn 
error  probability  by  i.  ode  redun  bin.  v  .  Ihus,  for  i sample,  it  was  shown  in 
t.hnptcr  \ll  tnat  m  milt  ipat  h  p  ro;  upu?  i  on  channels  the  reduction  ol  element 
length  to  a  value  on  the  order  of  the  bean  -ath  ilifterence  resulted  in  \erv 
abrupt  increase  in  error  probaht  Iit>.  Under  these  vonditions  it  o  |  l.unlv 
inadvisable  to  employ  a  redundancy,  coih  and  decrease  element  length.  \  rure 
correct  solution  would  be  To  use  a  code  ot  Iarye  base  r  enabl  i  ng  element 
lei.c’th  to  be  increase. i  with  the  same  rate  t  i  nl  eiTiat  i  on  t  r.irsri  ..i  un. 


!  •  *•  »*><  the  ••rot*  ah  i  tit*  • !  i  Mi'i  dues  not  i;k  h  im'  ,  or  iiu  re as e*. 

-  i  «  >  t  *  %  1  i  jjh  t 1  »  ,  wli  tti  the  !  <  ii  !  (.  •  .i  s  i  »;n.i  1  cl  crieri!  .  s  ■•hor'cnci!,  In  .i 

,  li  iniii  I  with  ti  I ..!  r.ih  r  ip  t  *1  '■  »ditik  s  h*> s t  en  i  n»;  the  length  ot  .in  clcr.cn'  ilc - 

fi.isi-.  its  j-owii  but  at  the  i  re  :  r  un  re  .i'c'  the  i  «rrc  I  .ii  i  on  between 

i|  ir.  t  the  t  r.uivr  i  s  *.  i  ,.n  t  .  1 1>  i  :  r  i.li  ucr!  elements.  Inasnuh  «s  tin  m 

:*..•  t.i,  tor**  n:  in  c]’|mm!c  di  r  r*  !  i  urn  .  umh  i  t  he  se  conditions  shor  t  en  i  !i|;  .in 
<  ic-cn:  imi.il  Ii  leads  on  I  %  to  a  s~.ill  m*  rc.ivc  in  the  probability  ami  snr.e- 
!  ir.cv  ic'l’i'i  i.ilh  !>’r  II'  s* stems)  e\  en  to  a  reJiiition.  In  the  i'.im  <>l  power  I  ul 
-i.t  irtro.pu-nt  in*!  I* ric!  i:-.j’ii|**c  uttcrtcrcmc  the  ;  ro!'.il'i  lit;  of  error  depend* 
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t  he  i  li 

•*•*•!  n  taste:  th.m  line  no  i  due  t  the  irure.oc  in  tin-  mir.be  r  ot  elements 
!  1 1  I  i  n  k;  in  eii  udcrnirt  n  r  Ir  ill  these  *  .ci-s  the  use  t»  t’  »  orreet  i  tij;  codes, 

i  i  rule  ,  IiMc.im  *  t  l  le  1  t  !  s  . 


I.  ru  w  on  in  th.is  c  t  i  on  we  hull  ririt  ourselves  to  the  *  a*e  oi  binary 

.  »v!i  in  i  .  h.uitie  I  u  i  1 1 .  !  I  u»  t  u  1 1  i  on  noi  ■>  i  , 

let  us  tiin!  the  .omlition  umh  r  win  ,  Ii  it  is  advisable  to  use  .1  roshimlatic  y 
.ids  in  .in  u  1  nt  s  r  •!  .oter  in  o'hcn  it  eiit  i  n  t  y  receptnn.  lot 

average  'it:rul  |  ever  nn!  tire  i .  s  i  i;:u  >!  to  t  r.ir  s~  i  s  s  i  on  ot  a  re  s  *  a  j;e  letter 
.ode  .  orb  i  n.it  i  on  I  be  nun.  he  will  .orpiro  re*  option  conditions  with  a 

s  ’  1 

i  edund.ifu'v  .  *'*le  ,  sa*h  .ode  .  o-l*  i  r.  .i  t  l  u.  )  which  sont.un*  n  elements  ,  I  ot  whieli 
ue  intorr.ition.il.  .ind  *u;  *li  t  luro  w  1 1  h  *  non  re.lumlancv  co*.c'  in  which  the  s' ode 
.  >rbm.it  ion  *  or, t. tins  l  cle-iri! 

I  he  no  i  s  e  re  s  i  v  t  .in  *  e  :  this  o  .'r-  is  .i*h  upi.t  t  e  1  v  sh.ii'.u  t  ei  i  :e*l  b\  the 
•  i  n  i  ~iir  *.  1 1  I n i  *  *  \  *1 1  s  t  itu  <•  1*  t  w*  en  tw.  .  o*h  *  orb i n,i t  ions 

r 

l>  Sr ' '  •"  do.j"j 

6 

shore  t  j  .in*;  .  t  ire  the  signals  .  or  respond  i  np  tu  the  two  code  combinations 
i  see  (,’h .ip  t  e  r  III 

In  the  *.is  -  ot  the  n  m  r*  It.m'ancv  code  the  pair  ot  nearest  code  .  orb  l  nat  i  or. 
.litters  n!\  i  r.  ru  element.  I  he  ret*  r  t ; .  rouphout  ora  element  tile  inte^ran*! 
in  e  v]'  rs  ssi  on  i  I  u .  l v  i  i  •-  *1 1  tie.  e  n  t  :  ro-  :ero  am!  mpuals  [  r  ( t  »  ;  C  t  ]  . 

•in*e  the  <-  ler.-nt  I  **n t  h  .  n  the  rum  -  r*  lurid, in.  \  *  *-*!e  is  I  I  .  then 


let  us  rer.ind  the  reader  that  entirrtv  and  e  lerent -b>  -element  reception  ire 
mui  a  lent  to  a  non  re*  lun.l  I'nJr  . 


Notes 


I.  (sc  i"  ’section  10.1  lu  "entirety  rac;'!  iuii"  t  h  1  s  chapter,  .is  ordinarily, 
means  the  reception  method  in  wli  i  v  h,  tin-  derision  svster  an:i)>;es  in  its  en 
tiretv  the  signal  segment  whn.li  corresponds  to  tlie  e  ode  corah  i  n.i  t  i  on .  \t  times 
entirety  reception  is  mentioned  in  the  sense  of  in.ilysis  of  i  signal  .ones 
ponding  to  an  entire  incoming  message.  It  is  ease  to  show  that  it  my  rode 
rombm.it  i  on  scquenci  in  tins  signal  has  the  same  a  priori  probability  ,  then 

s  iieh  rereption  el  the  entire  signal  has  m  advartape  ove  i  entirety  reception 
of  individual  combinations,  just  as  in  a  non  -  rednndanry  rode  ii.hen  ill  svmbol 
sequences  are  permissible  and  equ  i  probah  le  )  entirety  reception  lias  no  advantage 
over  element -by-element  reception. 

In  actual  fart,  not  all  code  combination  sequences  are  eqiu  probab 1 e  tor 
manv  sources.  Ibis  is  a  consequence  of  redundancy  in  the  source  alphabet. 

This  redundance  is,  however,  ordinarily  difficult  to  utilire  to  raise  recep¬ 
tion  reliability,  he  will  note  that  tor  a  memory  channel  in  which  the  values 
of  c.  are  correlated,  if  furthermore  condition  (10. 1 “ i  is  not  met,  entirety  re¬ 
ception  can  have  an  advantage  over  element -hy -element  rece|tion  even  in  the 
case  of  prim  tin*  coding. 

J .  (See  Sections  10.  J  and  10.  x)  Ihe  main  difficulty  in  realir.it  ion  of 
entirety  reception  and  methods  oi  reception  approx i-at i np  it  is  the  need  to 
remember  continuous  I  continual l  values  of  c  which  are  obtained  in  processing 

the  separate  signal  elements  or  their  sum.  Ur  this  purpose  .in. Hop  memory  de¬ 
vices  are  needed,  for  example,  the  surxiators  in  lipures  10.  J  and  10. o,  which 
are  more  difficult  to  make  than  the  discrete  devices  used  m  e  1  emit -by  -  e  lenient 
reception.  Iliis  problem  is  made  simpler  it  entirety  reception  is  used  for 
signals  v>  i  th  parallel  cod i up  (see  section  9.0),  since  in  tins  ease  the  results 
of  demodulation  of  c.  are  processed  simultaneously  and  tliev  need  not  be  stored 

for  an  extended  period. 

he  v.  i  1  1  note  that  the  complex  (wideband  signals  mentioned  in  '.  hupters  \  I  I 
and  VIII  can  also  be  cons i  vie  red  as  the  result  of  sequential  or  parallel  coding 
by  the  most  redundant  code  (n,  I'  considering  one  of  the  components  an  infor¬ 
mation  element  anil  all  lenaininp  the  diet1  eh"  lit  s .  hith  such  an  approach 
[la)  different  methods  of  receiving  s  ich  •.  i  ,  -  H  also  anount  t  o  optimal  co¬ 
herent  entiretv  reception,  to  incoherent  er.tiiety  reception  (with  coherent 
or  incoherent  cumulation',  uul  to  element  ‘  ■  element  reception.  'such  a  point 
of  view  is  possible  in  invest i pat i np  diversm  reception  [11].  hi  this  case 
optimal  coherent  additi  'ii  amounts  to  in  tbinp  cthei  than  coherent  <- tv  t  t  i  •  - 1  >  re¬ 
ception  and  quadratic  addition  ti  i  nc  •wieren  t  entinty  reception  with,  i  in  oh e rent 
cumulation.  Ihe  method  of  selection  in  the  case  1  diversity  reception  is 
particular  ease  of  deeodinp  based  on  the  most  reliable  symbols,  and  the  ethod 
of  discrete  addition  is  element  -b\ -e  ler.ent  recent  ion  with  the  corn  •tion  of 
errors.  Uich  a  sinple  approach  to  the  different  problems  ot  teceivirn;  sip 
nils  is  very  useful  since  't  permits  diicct  appln  it  ion  ef  the  results  ol  ;  lined 
in  one  area  to  the  solution  of  many  other  problems.  I  urt he  more  .  it  lead;  t. 
the  idea  that  ,1  mipht  be  possible  to  apple  several  methods  Irainlv  subopt i ~  1 1 


deve  loped  lor  .ui)  other  case  I  tor  example,  tor  diversity  reception)  to  the 
const  ruct  ion  of  new  systems  in  other  areas  (tor  example,  in  multiplexing  ind 
combining  channels,  etc.) 

3.  (See  Section  10.1)  Hie  first  inequality  in  expression  (IO.J~l  is 
obvious.  Let  us  pause  on  the  proof  of  the  second  inequalitv. 

He  will  consider  all  examples  of  undetected  errors.  So  that  should  an  error 
occur  (event  A.)  in  out i retv  reception  it  is  necessary  and  sufficient  that  for 

the  symbols  corresponding  to  ones  in  one  of  these  examples  inequality  (lU.Ji) 
he  met.  He  will  use  It  , ).  I .  -  1)  to  indicate  the  event  that  for  the 

k-th  example  of  an  undetected  error  (10. J 1  I  is  met.  Then  \.  is  equivalent  to 

occurrence  of  at  least  one  event  . 

Is  a  certain  s-th  example  is  the  sum  of  the  n  th  and  v  th  exann  ].•*■>  of  an 

undetected  error,  event  B  can  occur  onlv  when  at  least  one  event  B  or  B 

s  n  v 

occurs.  It  follows  that  for  event  it  is  necessarv  and  sufficient  that  at 

feast  me  of  in  events  B.  pertaininv.  to  ex.inples  of  error  not  represented  in 

•  ^ 

the  form  of  a  sum  of  other  examples  occur.  Inasmuch  as  the  probability  of  each, 
event  B  is  not  greater  than  p , ,  then 

I',  1‘t'd  I',/:,  or  /•',  or  l<.  >  .  IV«,»  i  ■  P|.'>\.  i- 

wh  i  ch  was  tc>  bv  j  re  ved. 


■1.  ('see  section  10.  ~  j  We  will  present  the  derivation  of  principle  Id.-Hy, 
for  a  code  permitting  majority  decoding  usii'u  the  system  of  separate  checks 
in  (10.  -la)  and  ( 1 0 . 4  A  a  | .  he  will  assume  that  the  results  of  demodulation  of 
c.^  which  are  mutually  independent  an  I  proportional  to  the  lava  nth  of  the 

likelihood  ratio  in  eloruet-  .-element  reception  correspond  to  symbols  c  : 

•  i  TV) 


where  k  i<  a  proport ional i tv  factor;  and  r  ^  is  a  received  signal  element  cor- 


res-  nndiru;  to  symbol  v  .  He  will  note  that  ter  any  optimal  circuit  in  e  lenient - 

by-element  reception  of  binary  -icnals  the  results  of  demodulation,  if  not  ex¬ 
pressed  In  formula  (10. in  . »n y  case  are  monotonic  reversibli  functions  of 

the  likelihood  ratio.  Ihi-n  tore,  thev  can  bt  t  ransforme,!  into  c .  values  which 

tm 


are  presented  by  this  forruli. 


He  will  find  tiu  1 Lke 1 i hood  ratio  for  symbol  v  by  assuming  that  c-  and 
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Unfortun at v ly ,  in  the  t  rails  1  .it  i  un  ei'  work  [~]  the  tern  ini>lu);y  used  in  it  is 
distorted.  I  he  tern  feedback  "before  decision"  (  predec  l  s  l  on  feedback  1  and 
"after  decision"  (,  p.,:'  tdec  i  s  l  on  feedbackl  are  translated  as  "information"  and 
"dec i s l  ni"  feedback ,  although  these  concepts  di  ml  quite  coincide. 
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repetitions  in  limited  s  i  ih  ■  when  the  r  rr  o  t\  i  o\ <■  i  I  oaded  rr  pi- t  1 1  i  on  •»  mist 
v  c.i'i  so  th.it  »eu  ml.'IT:  !  i>  i,  rr  i  t  t  ■  ■  .1  south'  v»  i  I  1  nut  I  r  lOnj'Irti'lv 

lost  .  I lew  run,  l!  tin  s  t  ;r  ot  tlw  til!  It  I  "lotaon  in  siitt  I  Cl  rnt  1  \  jjre.it  ,  the 
proba  ’  i  1  1 tv  o!  oin  in  1  i  vt  h  t  and  .  r  •  hr  t  i  i  st  .»; »} 1  ru  v  i  r  a  t  i  on  tin-  r.ur 

be?  Ot  It  pe  :  1  t  l  Oils  ..III  li  .I’ll  lie  ted  nil  I  l  :"l  "  i  d  . 

I  S  .  3  .  Inter  r  o<j«i  t  i  yn  b^sterj  in  a  b  i  h  >  <■  t  <•  C  ”  it'  nr  I 

P  r  i  >t  i  pa  I  Characteristics  ot  fir  j  I  f  (,  I  c  s  ;  j>  s  t  <■ 

Vn  o  \  r  t  w  hr  1  it.  i  iij;  n.i  ion  t '  o  f  i  '  i  n  t  1 14;  1 1  edn  ».  >  -  ■  str:  n  nr  j  n  t  r ;  t  u>;  .1 1  1  n 

Nvs.’rp.N  un  1 14:  .1  diNvrrtt  .h.mnel.  Ihrnlrrr.  we  w  1  1  1  Nrr.it  ibout  ther  'or,c- 

uh.it  mo  It  1 11  ih  - 1  1 1  I  t  li  .m  .ill  nt  hr  1  1 1  pe  s  .  lit  1  t  :  ,  i :  1  n  r  1  t  t  ml  me  s  s.i  pe  I  >r 

l>.-dund.UKi  Coded.  In  till  NIC,;  k  '!  I  lit  1  I  top  1  t  !  II  A  t  t  Uill  |'l  IT  |Mi  fi 

Node  I'ocih  11.1t  1  uns  ire  decoded  .md  n-nt  to  the  levipient  I'ri-  sect  pm  J .  -I  1 
In  th '  s  process  a  „  out  1  rrn.it  1  ot  signal  in  M  :.t  net  tin  n'U-in-  cli.mnrl.  It 

the  winli  conbiii.it  1  on  obtained  at  tin  uitpui  ot  t  hr  tirst  di  »  rinii  n  irnnt  is 

forbidden,  it  in  I't-.m!  .nut  an  ,nti  rr  nation  'i,;r.  il  in  <rnt  >\  1  1  t  hr  n-u  1  n. 
eh  amir  I  .  In  th;  wav  ,  1  nodi  »  rr.binat  ion  uhl  n  h  1  •  luri.  rd  1.0  iri  tlv  r  .1 1 

ri.uh  .1  iv  n  i|  irnt  •  l>  when  it  1  •nri-  ih.  t-  .  Whi  n  .m  1  nt  1  n  oc.it  1  on 

M^n.il  in  me!  ved  tin  ;  t  ree  11:  at  1  v  odr  >  orb  1  n.it  1  on  ;  n  :  t  1 1 «  d  and  then  1  r.  - 

tom.it’.Nti  t  r.iiiNn  1  n  n  1 ,  n  .untinm  n. 

let’s  .innusic  that  .1  Node  is  (;t\en  1  :  a  n  1-  ••  J  1  it  in  wiU  !  1  1  t  ourself  n 

to  the  n  isi'  ot  ..  clou:-  binary  in, I  -  cod>-  md  u«  u  1  1  I  .  t  In,  assn-e  •!  at  t  he 

properties  ot  the  di.inrul  are  I  noun.  I  hen  it  is  -m!-.  t  <.  dr  tr  mu  nr  t  hr 

pt  obal'i  1 1 1>  ot  a  nU  tented  error  I  ,  .  1  .1  .  .  tin  :  t  >  .1*  :  lit.  *  hat  1  ivt .  .1  !  t 

e»  *  ’ 

tin-  t  t  ansi:  1  tied  v  odr  n  nr.bin.it  ion  -or.-  other  ot  r  *  r  t  > :  b  i  id»  n  .  od-  n  orb  111.1 

t  1  on  n  1  n  n-ci'iin.  md  the  p  rob  ah  1  1 1  t .  o  t  in  urilctutf.l  >  rr  r  in  l  ,  1.0.. 

1  i  a 

the  probability  that  a  permitted  lonhinati.  ;  ri'Niii'd  which  ditters  t  j  on  tin- 

one  :  r ansru  1 1 rd .  1  'b \  i«  as  !  v  . 


where  in  tin-  pi  ot*ab  ;  !  1  tv  ot  rro  t  •  •  n  t  1  m  ot  ..  ,  edi  .  umb  1  n  1 1  1  ei. . 

Knowing  -these  probabilities  nul  1I-0  the  leiivtb  ot  .  .  n>.i  co:  b  1  n  at  1  0:1  n 
and  the  number  Nit  :  nt'ormat  1  on  symbols  i  1  r.  it,  it  i-  pos-ihli  to  nIi  1 1  1  no  the 

main  ch.irae  t  e  rt  s  t  1  c  s  o  t'  a  piven  system  to  which  the  relative  t  rat  mii  1  s<  1  on  rate 
s  md  the  equivalent  p  1  >  hah  1  1  1 1 y  if  error  p  pertain. 

By  relative  transmission  rate  we  mean  the  ratio  between  the  mathematical 

expectation  ot  a  number  ot  1  nt’ormat  ioti  symbols  reaching  a  recipient  and  the 

total  number  of  code  symbols  passed  in  the  fureard  channel.  When  everv  code 

combination  is  received  the  probability  is  I  |‘  that  the  recipient  is  issued 

1  •  de 

I.  inf  irritation  symbols  and  the  probability  is  I’  that  not  a  single  s  ytnbo  1  is 

vlL' 

delivered  to  him.  Ilierefo.c,  for  the  simplest  system 
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combination.  '1!  combinations  received  without  detected  errors  are  recorded 
in  appropriate  menor;.  ad  l-: ,  and  cells  corresponding  to  combinations  in  which 
errors  are  detected  remained  unfilled.  Vf'ter  completion  of  reception  of  the 
codogram  numbers  ( addresses t  of  combinations  not  received  are  sent  over  the 
reverse  channel  and  these  combinations  are  then  repeated  over  the  forward 
channels,  The  process  continues  until  the  entire  vodogram,  which  is  then  sent 
to  the  recipient,  is  received  (without  detected  errors). 

Under  ordinary  conditions  an  address  interrogation  system  does  not  have 
any  noteworthy  advantages  over  a  blocking  system  and  only  when  the  values  of  M 
are  very  large  does  it  give  a  certain  gain  in  relative  transmission  rate.  On 
the  other  hand,  the  address  svstem  has  definite  shortcomings .  The  principal 
one  is-  the  possibility  of  occurrence  of  specitic  errors  in  the  case  of  incorrect 
reception  of  an  address  transmitted  ove-  a  reverse  channel.  Therefore,  it  is 
necessary  to  employ  complex  encoding  and  decoding  with  error  eorre.tion  i  i>  the 
reverse  channel. 


Peculiarities  of  Duplex  Interrogation  Systems 


lnterrog.it  ion  systems  are  usually  duplex,  :  .  i  .  ,  in  them  information  is 
exchanged  m  both,  directions.  Ip,  tins  process  e..«.l.  of  the  two  one-way  channels 
1  used  partialis  as  a  t'orw  ir  1  and  partially  as  ..  reverse  ch.u  ne  I  .  Tv  using 
ar.y  method  of  multiplexing,  it  is  possible  to  transr.it  over  one  channel  a  main 
message  as  v*el  1  as  .mxi  I  pin  signals  f  confirmation  and  i  nt  er  rogat  i  on .  It  is 
most  convenient  to  use  time  multiplexing,  alternating  code  combi nat ions  carrying 
the  main  message  with  s.nice  cor  b  i  nut  i  or.s  .  ;  t  is  e.o  v  to  see  that  the  relative 

t  r  irisr  i  <s  i  on  rati  for  siuh  i  dupb  x  !•!  almg  -vster  p  .lotennined  by  formula 

lll.il'  when  n  *  n  replaces  :  ,  where  e  is  the  number  of  svr bo  I s  in  the  service 

orb  1 1,  at  i  op  winch,  getter  illy  spoiling,  max  differ  from  n: 


.s 


n 


'V 


M+l 


1 1 1 .  i :  i 


We  v,  i  1  1  s  .i  1 1  smh  a  duplex  system  a  svster  with  separated  servici  signals. 
Iiowevr,  core  frequently  a  lup  lex  ir.terrog.iti>:.  sict  is  i  mp  lerent  ed  differently 
;.t.,  with,  ur.separ.it  ed  sun  to  signals,  •  .>■  ; }-,  e  puipose  of  making  bettor  use 
.  t  the  v.  h.ii.iu  !  s  .  i«r  th,;s  pwrpese  confi  rm.it  lot.  signals  .,ro  not  transmitted  but 
m.torr  gati  n  signals  an  transmitted  whrj  e1  er  mvescin  ,  i.e.,  when  in  error  is 
deteitid  in  a  corbitiati  >n  ;  ransri  t  ted  over  the  other  cls.itme !  ,  interrupting  for 
this  period  of  time  the  t  ransni  «  i  ot,  of  the  main  message.  In.  this  proves-, 
unde  rs  t  and  ibl  x  ,  i  ,  ode  otr.b  i  r  at  i  on  differing  t  rc  ~.  those  i:m!  fir  the  rain 
message  is  assigned  h  t  ihi  i  nt  eirogat  i  on  .signal.  I  he  trausmissi  >n  «  t  a  com¬ 
bination  of  main  message  is  viewed  s  i  mu  1 1  an-- ms  I  y  ■<  coni  i  rma  t  l  on  of  reception 
of  the  last  comb i n at l on . 


\t  i  i  r  s  t  glance  such  a  s\  stem  seems  very  simple  and  penv.it  s  greatly  in¬ 
creasing  the  use  of  channels,  especial  lx-  in  cl, am.  -Is  of  s  a  t  i  s  f  act  orv  quality 
when  interrogation  signals  are  transmitted  infrequent 1\ .  Tut  m  fact  the  systei: 
becomes  more  complex  dm-  to  efforts  to  avoid  serious  distortions  in  a  message 
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caused  by  incorrect  reception  of  interrogation  instead  of  a  transmitted  message 
combination,  and  vice  versa.  It  must  be  kept  in  mind  that  in  such  a  duplex 
system  an  interrogation  combination  is  protected  from  error  no  better  than  any 
other  code  combination.  if  an  interrogation  signal  is  received  even  with  a 
detected  error,  it  will  not  he  recognized  and  instead  of  repetition  of  an  in¬ 
correctly  received  combination  an  interrogation  signal  will  he  sent  and  at 
best  this  leads  to  added  delay.  If  an  error  is  not  detected,  a  code  combina¬ 
tion  in  one  of  the  messages  will  be  lost  and  an  extra  one  will  .appear  in  the 

the  other. 

To  avoid  this,  use  is  made  of  the  complicated  operating  algorithm  of  a  du¬ 
plex  interrogation  system  which,  in  general  terms,  amounts  to  the  following. 

Any  detected  error  is  considered  simultaneously  as  an  interrogation  signal. 

Therefore,  in  the  detection  of  an  error,  just  as  i  >'  obtaining  an  interrogation 
signal,  an  interrogation  signal  is  also  sent  in  the  reverse  direction,  after 
which  M  +  1  combinations  from  a  ca 1 cu 1  at  or- repeat  or  are  repeated.  \t  the  same 
time  the  receiver  is  blocked  for  M  combinations.  Thus,  with  the  occurrence  of 
a  detected  error  in  one  direction,  both  receivers  are  blocked  and  the  last 
M  +  I  combinations  are  repeated  in  both  directions.  A  more  detailed  descrip¬ 
tion  of  this  cross  blocking  algorithm  can  be  found  in  work  [S,  9). 

The  equivalent  probability  of  error  in  such  a  duplex  system  in  the  first 
approximation  (without  consideration  of  undetected  errors  in  the  interrogation 
signal,)  is  expressed  by  the  same  formula  (11.1)  as  in  the  simplest  system  de¬ 
scribed  earlier.  The  relative  transmissi  ui  rati'  can  be  determined  by  considering 
that  the  recipient  is  issued  1  information  symbols  on  condition  that  the  pre¬ 
ceding  M  combinations  in  both  directions  are  received  without  detected  errors. 
Therefore , 
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where  I”,  is  the  probability  of  detected  error  in  the  opposite  direction. 


Comparing  ( 1  !  .  1 5 )  and  (11.12) ,  we  can  see  that  the  system  with  the  un¬ 
separated  service  signals  permits  increasing  the  relative  transmission  rate  on 
condition  that 

\i 
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Th i s  condition  is  met  onlv  in  rather  good  channels  when  I”,  ■  I  and  when  the 

ill’ 

blocking  of  M  is  not  long.  In  low  quality  chan. .els,  especially  in  transmission 
at  a  high  rate  and  over  long  distances  (which  leads  to  a  large  value  ot  Ml. 
the  system  w-i  th  separated  sendee  signals  is  most  advantageous. 

Selection  of  a  Code  for  ai  Interrogation  System 

At  the  present  time  no  methods  are  known  which  permit  finding  for  an  in¬ 
terrogation  system  an  optimal  code  providing  for  a  maximum  relatin'  trans¬ 
mission  rate  with  a  given  level  of  fidelity  or  maximum  fidelity  at  a  given  rate. 


590- 


.1, 


1  IiHvl".  C 

r ,  s 

ov  o  r 

a  1 

1  t 

Ion 

a  i 

JlHII 

t  ho 

i  t  ■ 

ma 

i  n 

Sf.l  l'Ol 

1 1  p.j; 

1 1 '  r , 

i  i  snii  ■  .!.  '  ■  •  •  ;  'i 

\\  0  Is  1  1 

1  1*0 

i\  i  n 

i 

til 

a 

run 

1  .Ir 

rat  i 

i'll 

ol 

a  oon 

■  t  .111  t 

sli  so 

IV  1  r 

s  Ji.ii.nr  !  . 

1; 

i  t\s  L 

WO 

w  i 

1 1 

IU  • 

r.o 

t  hat 

a  os 

;  rd 

!  Hi; 

1  0  1 

ll.lt 

t  in 

Cljli  1  ' 

..  lent  ;  :\>!  i ! * s  It’s 

or  ror 

is  p 

roport 

i  ona  1 

Li) 

thr 

p  ruhab 

1  !  ! 

ty  r! 

all  Uinlrtr 

0 1  r  .  i 

r  !' !' 1  r  1’  .  1  hr  Pc  I 

lie 

it  is 

i'i  rs 

t  ns' 

so 

S  !->  » 

i  ry 

t  o 

!  -  iv 

V  1  do 

1  o 

i  a 

Sill  t 

i  o  i  rn  t 1 s  s 

K..1  J  1 

\ a  1  ur  nk  !  .  fir 

llr 

(\  1  .  o  ' 

and 

i  '  1 

- 

1  i 

*0 

nay 

.  Oli 

o  hid 

o  ! 

hat 

!'.  r 

tins  j 

ui  rpo 

sc  i 

ouslr  i::us t  !ia  \  t  .. 

sut't'i  o 

i  on  t 

iy  1 

a  r 

ip-' 

Ml  1 

n  i  in 

al  h 

a  mi  i::  i 

d  1  u 

t  an  ,  r 

d 

(hi 

l  llr 

ot  hr  r  Italic  ,  t  hr  -  r 

mm  n 

must  h 

a\  o 

1 

ros 

lun 

dnnoy , 

:  .  o . 

r 

ho 

k  n  r 

all  v.i  i : 

SHIS  t 

not  1 

•v  \rrs  si:... !  1  si  nor 

tho  ru 

l  so 

,  i, . , 

*’o 

1  .i  t  i  . 

o  t 

:*  in> 

i.:  i  -  s 

i  on 

:  i 

1  ,  i%  .  • 

!•( 

*  dt  , 

i  t  a  ■  ' 

a  .  1  i  T.i<  •  r  .  v.  i  ! !. 

s;::,t  1  1 

rodu 

llU.ill 

oy 

i  1 

.  v  > 

p  rot 

.  .  i 

i  in’ 

i  t  •  r 

j 

!. li¬ 

Vi  d 

r 

,  \\  l 

i  n 

■ 

t  list 

■  .  .sit  v.  M  !,  a  i  on 

Is 

ut  : 

no  i\' 

si  s 

:  \n 

'  !  1 

Is 

.ui' 

;  *  .1 

n  : 

no  i 

!.•  .  1  o 

.a  I  !u 

•  pro 

i > .1 1  . 

:  i '  s  'h  .i  .!  t c  ■ :  ■  : 

vvov  l‘.  whi-h,  in  turn,  Iihuts  t  n  •  •  rn  ii  iu*  t  :*  ia-o\  i  ss  i  r.ii  •  ili.J  ,  !l. 

\  1 1  ■ 

i  I  I  .  1  a  l  ,mJ  iiKiv.i  .i1'  tin-  i ■  ; 1 1  i  \ . t !  •  :  :  r  re!  li  •  i  i  i  i  y  o i‘  r  it  ■ !  -  !  !  .  -I  i  .  nbv i cus  h 


t ill' Pr 

must  I- 

v  all  cr  tl  Hull 

t  Util  -  i .  1 1 

>t  t .  a  ir; 

"rlki  Ills'.  ' 

•!•  !  :  r  pi 

o !  .  u  ■ .  i  i  i  \  t 

i\  rlTi  1 

111  .1  0 

hur.nr  1 

aik!  i !  so  t,m 

!  fir  I'atr 

.'!  t  rails 

raia. 

a:.M  ran.* 

oi  ou!:i!:.n: 

» i  o .  1 1  i  :  • 

tide  n;i 

i  n  i  n  u 

t  lir  b  k  ok  i  p. 

Irllt'.  I  !l  .' 

\  " .  !n 

■  o  1  o  o  *  i  i 

.i  \  Ik. 

r  t>!  1.  It's- 

•  ;  flail 

1 1  1 

tho  pr 

vb.ib  i  1  i  ty  t'k 

Ill  Illi.lrt 

r  rtf  rl'l 

'or  UWs 

u* ,  i  r 

l-'kP  llkl  t Ik'  V 

i  s  i  if.'  j- 

in  order  1 1 

rot  a  ip.  !’:  >io  1 

i  :  \  ,  J  ho 

:  •  •  i :  1 1  i  vr 

t  r.u.v:  i  S 

■i  -11  -at 

o  i-  a- ‘Oi". 

hr.!.  ! 

U  rt 

in  an 

p.  Iars  :  t  !i. 

a.  i  :  *  . 

.  t'-r  pi 

■ki'.i!  .ill 

.  k  .!.-• 

<  v  t  !  a.  a.  k 

:  i\  r  i  r: 

ro.  ‘ir 

s  ilk! 

tills  I'tsilla  s 

♦  \  •  • , 

i  .  •  a  lit! 

r  1 1 1  .  1 

•  i  ■  lift 

i !  It  ! 

:  r  !  !  !,U 

■p  1 1  in.i 

!  p  an 

a  1  y  t  i  o  1 1  1  v  s 

Ik  it  fill. 

t.1  .ill  . i «' i a 

l  !  V  t  i  V.  |  i 

o  \  p  i  o;.  a  i  i, 

t  ’.  i  r  1 

a  o 

1  hr  ret 

o  1*0*  .  I 

L  is  a  c  t 1  -  . .  i ; 

I  \  '  .O'- 

It'  i  ti!  .  . 

■  ap:  P." 

.  -at  i  ll. 

hus  ,  t 

dr  OI'imm-  1 

T 

a.  o*  s-s.ii  . 

*  .  , 

•  .t-c  r  , 

Ok.  ;■  f.-W 

r  i  .  i 

lr 

.  t. 

:::u  •  t  ! 

o  do  o  r 

'-hr.!  .  II..  • 

v out  1  a  !  . 

0!  .  t  tl. 

1  - 

:  •  ■ 

■  Ml.  .  1 

.  :  tl  i.t 

ao  Jo  and  ill 

;  tc  ra  t  i  or  1  ill 

:  o  rr<  , .  1 1  . 

•  i .  •  v .  a 

1  1  •  • 

4  .  ■  .  , 

i  ■ .  t ; . 

‘  N  ! ■  1 

Iso  ; 

;-..u:o  o 

t  .'I  V  t  • 

P.l  1  Os)  i  I  '  ..  1 

:  ay. o'  o.  ! 

.  i  .  i ! 

•  i  0  O  : 

•  oil.  -  . 

•  *  . 

’  1  r  '  ■  * 

o  aso  , 

tlW  a 

t  Wo  st  a  y  o  o  ot 

!•  ,  tv 

1  o  .  s  ! 

' 

:  '  .  . .  i 

1 

J*  *  ,  .  *  . 

OU  .  ,.!• 

t  a:  ft 

1.  1  i  on  IV  i  1  O 

.  t  1 

1  r.  :  1 

t  .v  a  :  \\  . 

!  V  1 

•o.i  0*1  ^ 

oi  ;;-.n  . 

!  a  -  PI  •  1  1 

t  od  I  .  W 

1  ■:  ' 

i 

.1  IP.: 

.11.1  .til 

tho\  « 

V'  di  t 

rot's!  .  . 

rropat  . 

• 

s 

*  . :  * 

:  .a  .  v : 

•  :  •  • 

nnt  i  i 

It  is 

v •  ao  i  \  *o.l  i. ;  t. : 

'.Oil* 

•  .  •  •  -  : 

1  l  , .  . ,  • 

.  .  *  .1 

1  ’i  !  ol 

,  (  1  •  • 

:  ■  ■  i  u 

is  ith  u 

1  .  i  d  *. 

t  '  :  .!  t  IS  ■  P 

’  ■  a :  *  : 

,  t  .  O 

!  ■  •  ( 

•  *,  i  '  i"  • 

v.  i  !  h 

IV-PM 

:  to. 

oiur.iM.  i:  i 

i  : .  '  : :  !  v 

*o."  n. 

•  .  l  or  : 

1  .  V*v‘  . 

•a  i  ‘  J  !  \ 

i  !  .  a.  t 

0  1  111. ill 

,  tin.- 

'•lit  !  :•.  t  ap  I- 

■  :  '  ■ 

>.  •  v  •  V,  . 

K  i 

th 

a  1'atlir  r  • 

1.  rt  : 

i  *V\  *  ! 

V  t  1  lilt 

‘  .do  a 

t  „  :  •  ;  .-at  p.  u  •  - 

it  it  ,:.u 

Ik  tflior. 

t.h- 

■  Pr  1  1 1  i M 

1  a!  t 

v  •  *  ’ 

1  alisili :  s  ■ 

:  t  i  ! 

t  •  *  I  •  .  It  :  !  n.r  :  fiat 

:  i  i .  •  1 1  is 

a  it  n  l 

t  l  a 

tilt  ;  roi  at 

i  ;  1 1 

•  i  a 

i  un. hit 

at  rd 

■  i  Pc rin  .  iv it  but  ii;is 

1  Pa-  t'.r 

.!  til i;i  r 

in.i 

■•I'.uoii  is 

■  loll  '  I 

To  r 

kill  It 

•  it  *  •  • 

tiki  kin  r  t  in-  ^  !.t  t  i  i 

'  l  ulli.t-ti 

tin-  •] 

:.i::n 

i'i:  t  ir 

1  111- . 

,'.ii1d 

1  :  ■  i 

.  -  r  r-  • . 

•  i . :  .u:-  1 1  !  ■  i  ;  ops 

-ii  tin  r 

?  fir  !k. 

0 , 1 1  > 

:  !  i  :  \  t  ■ 

T  r  ; 

r  <  *  j  • . 

1 ' '  i  ‘ 

.  1  i  .  in  rt;  .  1 r  :  •  - 1  t  :  •  •  , 

t  lit-  l-'S. 

t  .ll  lr  i 

nlo 

r  p  v;a  l  i .  •; i 

k  on  r 

::uu! 

:  :  i  >  •  i 

.  i » t  1  \ 

t  ii  uh.  ii  oi  o  :  tl  :  ;;  a  r\  o 

,  !'  rt  : 

- . i  (.'ll,  ;  ii  ,,k!  . . tin t '  i  '  sk.iuh ti¬ 


lt  •- t-i. . 


I  nformat  ion 


symbo I s 


o 

_Q 


u 

u 

c 


Check  symbols  for 
co  I  until  s 


f  i'jun1  1  !..?*•  Construction  ol  a  Two-Stage 
I le ru l i . e  Code . 
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this  means  that  in  states  when  p  ■  p  not  a  single  code  combination  will  reach 

the  recipient,  i.e.,  the  transmitted  combination  will  be  repeated  until  the 
probability  of  error  in  the  chain,  1  decreases.  In  "good"  conditions  when  p  •  p^ 

messages  will  be  transmitted  with  a  probability  not  less  than  that  prescribed. 

Condition  (II. lb)  can  always  be  met  by  selecting  a  sufficiently  long  com¬ 
bination  (which  increases  1’^  for  large  values  of  p)  and  a  sufficient  blocking 

length  of  M.  At  the  same  time,  when  p  •  p^  the  relative  transmission  rate  S  can 

be  rather  great.  Inasmuch  as  p  is  greater  than  the  median  value,  "good"  states 

of  a  channel  when  p  p^  will  occupy  more  than  50'!,  of  the  time  and  the  average 

transmission  rate  of  information  will  be  sufficiently  great. 

Without  pausing  over  the  details  of  selecting  a  code,  we  will  present  a 
somewhat  simplified  example,  let  there  be  in  a  channel  with  equal  probabilities 
three  states  described  by  the  probab i 1 . t i es  of  error  p  ■  10*',  p,  on  the  order 

of  10*-  ,  and  p_  10_i  or  even  p_  -  0.5  (complete  disruption  in  communication) 

and  the  average  duration  in  each  state  be  equal  to  10  seconds.  We  will  use  a 
rated  speed  of  transmission  equal  to  1,000  bauds  and  require  that  the  equivalent 

probability  of  error  not  exceed  p(i  -  10  1J. 

These  conditions  can  be  met  by  using  a  l',ou.:-(!houdkhuri  [63.45J  code  in  a 
blocking  system  where  M  =  5.  Figure  11.4  shows  for  this  instance  the  dependence 
of  average  time  t ^  required  for  the  transmission  of  the  code  combination  on  the 

probability  of  error  p  constructed  in  accordance  with  formulas  (11.15),  (11.11), 
and  (11.9) .  The  dependence  of  p  on  p  from  Figure  11.2  is  also  entered  there. 

lor  an  illustration  of  the  role  played  by  clocking  the  broken  line  shows  the 

curve  for  t]  in  a  system  without  blocking.  As  can  be  seen  from  the  figure,  in 

the  first  channel  state  (p  ■  10)  a  message  is  transmitted  at  a  great  rate  on 

the  order  of  lo  combinations  (about  "20  bits)  per  second,  and  the  equivalent 

-10  -  2 
probability  ol  error  is  much  less  than  10  .  In  the  second  state  (p  -  10  ) 

the  rate  of  transmission  is  much  reduced  and  :n  one  second  not  more  than  the 

1-2  combinations  (45-90  bits)  are  transmitted  and  the  equivalent  probability  of 

error  reaches  10  In  the  third  ..t.ate  (p  •  0.1)  the  code  combination  could  be 

transmitted  on  the  average  over  a  period  of  two  years  or  more  if  the  state  were 
maintained.  In  actual  fact,  transmission  con.;  .etely  ceases  in  this  state  and 
the  receiver  remains  blocked  until  the  state  changes.  The  probability  of  re¬ 
ceiving  a  code  combination  in  this  state  is  so  slight  that  it  does  not  affect 
the  average  equivalent  probability  of  error  which,  thusly,  does  rot  exceed 

10  *0.  Ihe  average  transmission  rate  is  about  six  combinations  (2~()  bits)  per 

second,  i.e.,  higher  than  27"  of  the  channel  carrying  capacity  in  the  best 
state. 


F  i  gu  re  .1  1  .  1| .  Equivalent  Probability  of 
Error  and  Average  Time  of  Transmission 

of  the  Code  Combination  tj  for  a  (ls3  ,  ^5^ 

Code  When  v  =  1000  Bauds:  - ,  M  =  3 1 

-  -  -  - ,  M  =  0. 

As  can  be  seen  from  the  figure,  this  code  gives  good  results  with  a  channel 
in  which  the  median  value  of  probability  of  error  is  close  to  10"- .  With  a 
smaller  median  value  of  p  longer  code  combinations  should  be  used  and  with  a 
large  median  value  shorter  combinations  should  he  used.  Thus,  an  interrogation 
system  permits  successful  use  of  "bad"  ch.nnels  in  which  the  probability  of 
error  fluctuates  around  a  rather  large  value  and  even  brief  disruptions  in 
common i cat i on  occur . 

I  I . k .  Interrogation  Systems  in  a  Continuous  Channel 

Interrogation  systems  in  a  continuous  channel  are  different  from  those 
described  above  in  that  a  decision  to  repeat  a  certain  signal  segment  is  reached 
not  in  the  process  of  decoding  but  in  the  first  decision  system  based  on  an 
analysis  of  a  received  continuous  signal.  Their  advantage  lies  in  the  fact  that 
for  reaching  a  decision  use  is  made  of  all  information  included  in  an  arriving 
signal  while  with  interrogation  in  a  discrete  channel  some  of  the  information  is 
inevitably  lost  in  the  process  of  demodulation. 

A  transmitted  message  may  be  encoded  In  a  primitive  code.  lor  detection 
of  a  possible  error  and  reaching  a  decision  about  interrogation,  the  first  de¬ 
cision  system,  as  a  rule,  determines  the  likelihood  functions  for  possible 
transmitted  symbols  and  compares  them.  If  one  of  them  greatly  exceeds  the 
others,  a  final  decision  is  reached  and  a  received  message  after  decoding  is 
sent  to  the  recipient.  If  for  two  symbols  the  values  of  the  likelihood  function 
are  close  to  one  another  this  signal  is  rejected  and  an  interrogation  signal  is 
sent  over  the  reverse  channel. 

for  an  example  we  will  consider  a  binary  system  with  signals  orthogonal 
in  the  intensified  sense  with  an  active  pause  and  in  the  case  of  incoherent 
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oi  interrogation  ami  continuation  in  the  ton:,  ot  rather  long  combinations. 

It'  the  rated  speed  of  transmission  in  the  forward  and  reverse  channels  is 

the  same,  e  1  omen t-l>y -element  check  is  no  longer  possible.  It  is  necessary  to 

check  whole  code  combinations  containing  at  least  as  many  symbols  as  are  in 
the  service  signals.  \n  interrogation  signal  is  sent  in  that  case  when  during 
demodulation  at  least  one  of  the  elements  of  the  code  combination  the  di f- 

ference  Y~  -  Y“  is  in  the  erasure  zone. 

l'he  ma.vimal  rate  of  transmission  with  a  given  level  of  fidelity  or  maximal 
fidelity  with  a  given  rate  must  he  provided  by  selection  of  an  optimal  erasure 
zone  [IS]  which  plays  the  same  role  as  selection  of  .he  code  in  a  discrete 
channe  1 . 

In  a  continuous  channel  it  is  also  possible  to  implement  a  duplex  inter¬ 
rogation  system  in  the  same  way  as  in  a  discrete  channel,  i.e.,  by  using 

separated  or  unseparated  service  signals.  In  the  latter  case  it  is  necessary 
to  use  cross  blocking. 

If  a  main  message  is  encoded  with  redundancy,  it  is  possible  to  effect  en¬ 
tirety  interrogation  reception.  In  this  case  a  single  decision  system  evaluates 
the  likelihood  functions  for  all  permissible  combinations  and  if  one  of  them 
greatly  exceeds  all  others,  it  is  issued  co  the  recipient.  If  the  diffeience 
between  the  two  greatest  values  of  the  likelihood  functions  is  not  great,  i.e., 
the  level  of  fidelity  of  the  decision  readied  is  low,  an  interrogation  is  sent. 

It  is  also  possible  to  combine  interrogation  systems  in  discrete  and  con¬ 
tinuous  channels  In  effecting  a  check  of  each  symbol  of  a  combination  falling 
in  the  erasure  zone  and  then  check  ini;  the  entire  combination  for  the  presence 
of  detected  errors.  Accorui.. g  Hi  some  data  such  a  system  could  he  very  effec¬ 
tive  if  the  code  and  erasure  zone  are  selected  properly. 


11.5*  Systems  With  Information  Feedback 
Systv.."  With  Reverse  Check  and  Repeat 

A  system  with  reverse  check  and  repeat  is  the  simplest  of  the  systems  w;th 
information  feedback  in  a  discrete  channel  [2b]  .  A  message  transmitted  over  a 
forward  channel  is  encoded  with  the  minimal  i edundancy  required  to  discriminate 
one  service  combination  of  "negation."  The  last  M  transmitted  code  combinations 
where  M  is  determined  from  expression  (.11.101  are  stored  in  the  calculator- 
repeater  of  the  transmitter.  fhe  received  code  svmbols  are  recorded  in  a  unit 
of  tile  buffer  memory  of  the  receiver  and  sent  over  the  reverse  channel.  The 
code  symbols  arriving  over  the  reverse  channel  are  compared  with  those  stored 
in  the  repeater  and  if  they  do  not  coincide,  a  negation  signal  is  sent  over  the 
forward  channel  and  then  .ill  M  combinations  from  the  repeater  are  repeated.' 

In  principle  it  should  be  possible  to  limit  oneself  to  repetition  of  one  com¬ 
bination  of  even  one  symbol,  but  this  leads  to  complexity  in  the  control  system, 
an  increase  in  the  size  of  the  buffer  memory,  and  retention  of  the  probability 
of  overloadiin  just  as  in  an  interrogation  system  without  blocking. 


Rased  on  the  received  negation  signal,  M  combinations  arc  erased  in  the  buffer 
memory  ot'  the  receiver.  bach  received  combi  nat  ion  is  issued  to  the  recipient 
only  when  M  combinations  not  contained  an  erasure  signal  have  been  received 
a  I't  or  it. 

file  possibility  that  there  will  be  an  incorrect  symbol  in  a  message  issued 
to  a  recipient  occurs  only  when  the  first  symbol  is  received  incorrectly  in  the 
reverse  channel  and  a  repeated  incorrect  symbol  was  transformed  into  a  correct 
symbol  in  the  reverse  channel.  Such  a  pair  of  errors  is  called  an  imavi  error. 
In  a  binary  system  the  probability  of  this  is 


uc 


(ll.dbj 


where  p  and  p ,  are  the  probabilities  of  error  in  the  forward  and  reverse 
channels  respect ively . 

lie  will  note  that  incorrect  reception  of  a  negation  signal  does  not  in¬ 
crease  the  probability  of  an  undetected  error.  After  it  has  been  checked  two 
negation  signals  will  be  sent  over  the  re'erse  channel  and  two  M  comb i nat i ons 
will  be  erased  in  the  receiver  buffer  memory.  It  \:  only  necessary  to  provide 
for  a  sufficient  reserve.  If  the  inform.a  ion  combination  is  received  as  a 
negation  signal,  the  erased  symbols  are  simply  repeated. 

It  is  apparent  from  (ll.Jb)  that  such  a  system  can  well  be  used  wlv.  •'  the 
probability  of  error  in  the  reverse  channel  is  much  less  than  n  the  forwaid, 
for  example,  in  the  transmission  of  messages  from  a  spacecraft  when  it  is 
possible  to  use  for  the  reverse  channel  a  ground  transmitter  of  much  greater 
power  than  the  onboard  transmitter. 

Reasoning  as  in  the  preceding  section,  we  can  show  that  the  equivalent  pro- 
bab i  1 i tv  o f  e r ro r  i s 

~  '\ie 

Pe  T-7—  Cl  1  -27) 

1  de 

where  p^  is  the  probability  that  an  error  which  was  detected  occurred  in  the 
forward  or  reverse  channel 
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(11. 28) 


where  n  is  the  number  of  svmbols  in  a  combination. 


The  relative  rate  of  transmission  can  be  determined  approximately  by  taking 
into  account  the  fact  that  a  code  combination  is  emitted  to  a  recipient  if  it 
is  not  a  negation  signal  and  if  it  and  the  following  M  combinations  are  re¬ 
ceived  correctly  in  the  forward  and  reverse  channels  or  if  errors  were  not 
detected.  The  probability  that  a  transmitted  combination  is  not  a  negation 
signal  is  equal  to  the  probability  that  one  combination  passed  without  detected 
errors  111  the  forward  and  reverse  channels.  Thus  (if  the  probability  of  an  un¬ 
detected  image  error  is  ignored), 
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Duplex  »>;.■>  tiTi-  ot  radio  commun  i  .  .it  i  on  imol'  inr  1 c !  .  ■.  .  t  :  on  !  101  r 

traces  can  he  relegated  to  systems  ot  1  ni  urn.  t!  1  <  11  kcdbel  it;  a  1  out  1  mioir. 

channel  [oj  .  In  them  1  ufurni.it  1  on  is  t  ran  mi  1 1  cd  only  uaa  '-In  a  t  seemnu  : 

time  while  there  is  lie  1  yth  t  cued  1  orn  tat  ion  ot  the  lower  la\ers  ot  the  i  >110 

sphere  caused  ip  a  passing  meteor.  [Hinny  all  ivr  .1 1  n  1  n>.  tire  sound  up.  pul  ■  >- 

are  sent  to  both  channels.  I  nlorii.it  ion  about  the  possibility  ot  t  1  atismi  t  t  1  nr 

1  n  format  1  on  is  extracted  trot;,  the  pulses  arriving  v,-r  t  lie  i  •  v  <  is1  ch  mu,-!. 

I  he  d  1  scout  1  nuoiis  commun 1  cat  1  on  based  on  such  prinnj  li  s  1  a  I  o  j  •  -sm  l  !e 

in  shortwave  channels  when  the  is  ate  apv  at  foe  r  channels  w.tii  d  c»  ladinr.  I: 

this  case  by  using  the  1  nl  ornuit  1  on  obtained  over  the  •averse  .  h .  >  1 1 1 1  ■  i  ••ess.urs 

are  transmitted  only  when  the  transmission  (actor  of  the  channel  <  a 

certain  threshold  value  .  .  U'hcn  .  „  coiamuni  cat  1  on  is  interrupt'd  and  onh 

0  0  1 

sounding  pulses  essential  to  evaluate  .  are  transmitted.  Ihis  poirits,  wit!, 

a  1,1  veil  level  of  fidelity,  increasing  the  rated  speed  ol  1 1  ansmi  ss  i  on  inasmuch 

as  it  is  conducted  only  with  a  good  channel  state.  I  he  average  rate  of  infur 

mation  transmission  when  the  threshold  ^  is  selected  optimally  i-  much  yreat cr 

than  in  the  case  of  ordinary  continuous  coimmin  1  cat  i  on  with  the  same  level  of 
fidelity  [JO-JdJ. 

11.6.  Adaptive  Methods  of  Encoding  and  Decoding 

The  existence  ot'  feedback  permits  adapt  iny  the  methods  of  transmitting 
and  receiving  signals  to  channel  state.  Communication  systems  in  which  a  «.ode 
remains  unchanged  but  the  method  of  decoding  and  use  of  feedback  change 
in  accordance  with  a  channel  state  are  called  systems  with  adaptive  decoding. 
The  same  systems  in  which  with  a  change  in  channel  state  the  method  of  coding 
also  changes  fin  the  narrow  or  broad  sensei  are  called  systems  with  adaptive 
cod i ng . 


We  will  present  an  example  to  explain  the  possibilities  of  adaptive  de¬ 
coding.  Let  a  message  be  encoded  by  a  code  with  a  minimal  Hamming  distance 
d  .  =  "> .  specifically  |~,  -1 )  group  code.  In  the  receiver,  along  with  an  or- 

dinarv  e  1  orient  -bv-c  lenient  decision  system,  there  is  a  demodulator  with  a  zero 
zone  formed  by  two  symmetrica!  thresholds  selected,  in  accordan  v  with  I  11. dll 
and  also  a  counter  which  counts  the  number  of  times  the  result  'f  demodulation 
falls  in  the  zero  zone  over  a  specific  time  interval.  hi  the  channel  in  a  good 
state  this  is  a  little  probable  and  vc i t h  worsening  in  the  state  this  probabi¬ 
lity  increases.  Tims,  the  readings  of  the  counter  permit  judging  t  lu  state  of 
the  channel. 

If  the  number  of  times  a  demodulated  signal  falls  in  the  zero  zi  tie  is  not 
recorded,  a  icceived  code  combination  is  decoded  in  the  usual  way  and  a  single 
error  can  be  corrected.  When  a  demodulated  signal  falls  in  the  zero  zone  once 
or  twice  over  the  length  of  a  code  combination,  the  corresponding  symbols  are 
rejected  and  decoding  is  done  based  on  the  remaining  "most  reliable"  symbols 
(see  Section  10. 6J .  If  the  number  of  times  reaches  three  or  four,  the  code  is 
used  only  to  detect  errors.  In  other  words,  the  code  combination  is  decoded 
only  on  condition  that  it  is  a  permitted  one.  otherwise  an  interrogation  i  '■ 


r>t.  1  - 


nt  .  i  -  the  icvei  i  vli.iimrl.  Iin.ill),  i!  non  than  I  uiir  values  u!  the  do 
,  ;  i  .it  <•.!  si^n.il  t  ,i  1  I  in  the  .-ere  gone  .  decoding  evert  of'  .1  permuted  combina- 
t  lit  i  ii.it  pertormed  tinisr.wch  .is  in  ,i  rh  .nine  I  in  :i  bad  st.ite  the  probability 
.  i  hi  nmleti  ted  etrur  i i,  re.it  i  and  ,,n  i  nt  e  rrug  a  t  i  on  is  sent  over  the  reverse 
ch  e.. lie  I  . 

Is  i  t  h  .i  proper  --election  of  thresholds  such  n  system  van  provide  tor  an 
exceedingly  high  level  of  fidelity.  \t  the  sane  time  the  average  rate  of'  in¬ 
fer'..  it  ion  tmo'.i'^K'i.  turns  out  to  be  higher  than  in  an  ordinary  interrogation 

-t  '.tvr.  or  an  .  rdin.m  system  with  i  n  format  i  on  system  or  an  ordinary  system  with 

i  ntorm.it  i  on  feedback  inasmuch  as  errors  are  corrected  without  interrogation 
ir.d  re;  at  in  i  han'iel  with  sat  i  s  fact  ory  states.  I  urt  hermore ,  with  an  ordinary 
i  nt  er  rogat  >  n  sy  >toi:.,  and  especially  with  a  system  providing  for  vorrevtion  of 
error'',  .  t  would  be  necessary  to  use  a  mueh  more  complex  code  to  obtain  such 
a  level  ■  f  t'idelitv  .  \  nii're  di  tailed  discussion  of  these  methods  and  a  1  so  a 

ie- c  r  i  r '.  i  n  ot  ;!ter  methods  of  adaptive  decoding  can  be  found  in  work  [23]  . 

Vet  hods  of  adaptive  coding  pr*.  sent  .indition.il  possibilities  for  channels 
with  ■  low  ly  cli.iiu;  i  ny  parameters.  \  simple  code  with  low  redundancy  is  used  in 

i  channel  in  i  good  s’  ite  and  with  wer-eiiing  in  the  state  a  switch  is  made 
toward  a  mom  loir)  lex  code  with  pn  .iter  redundancy,  slowing  the  rate  of  infor¬ 
mal  i  n.  t  ransr.i  ss  i  on  but  maint  lining  a  given  level  of  t'idelitv.  The  state  of  a 

ii  i 1 1 : i e 1  call  be  judged  i  ron,  special  signals  which  are  sent  over  the  reverse 
Jianne!  >r,  more  simply,  hv  counting  the  frequency  of  arrival  of  interrogation 
s i gna 1 s  . 

In  mo.fiplextd  channel-  adaptive  co  ling  can  be  lone  by  changing  the  multi¬ 
plexing  t.Kfi-r  and  this  is  r..<\  to  do  i  r  the  case  of  sources  with  a  controllable 
i  ate. 

I  he  thvo"y  of  .o..antiv"  coding  lias  not  actually  been  worked  out  and  there¬ 
fore  we  must  limit  ourselves  to  the  ideas  expressed  above. 

Notes 

1.  I  he  existence  f  a  f-edhal  channel  in  principle  can  tture.isc  the 
carrying  capacity  of  ;i  f'orw.ird  channel  with  memory.  Ibis  increase  occurs  only 
because  in  format  •  si  is  >bt  a  i  tied  about  th  •  sfat-  of  channel  and  c;  nrot  exceed 
the  rate  at  wh i  i.  it  i-  t ransmi t t ed  |!0].  lor  a  constant  channel  tee  channel 
capacity  cannot  be  increased  by  u  : ng  feedback  [19]. 

in  .channels  used  in  ;  ncl,.r  the  rate  of  change  ot  state  :s  usually  slow 
ami  tile  conditions  themselves  ire  measured  without  very  great  aceuracy.  There¬ 
fore,  information  about  tin  st  ite  of  a  forward  channel  is  extracted  from  a  re 
verse  channel  with  a  slow  rate  and  it  can  be  considered  tnat  for  all  practical 
purposes  the  existence  of  feed!  ick  has  no  effect  on  the  earning  capacity. 

(dee  Section  11. Si  i a  calculating  the  relative  rate  of  t ransmi ss i on 
in  tile  siii.pl. -st  system  (11.2)  and  in  a  system  with  separated  service  signals 
(11,12)  no  account  was  t  Ten  o*  the  delay  incurred  hv  incorrect  reception  of 
service  signals.  Ihi  debar  o,  curs  if  an  isvmnie  t  r .  i  a  1  principle  of  di  coding 


serv  ice  •ignul>  is  used  tor  protect  :  <>i.  ugniipt  him  rt  s  ami  dropout  s  uni  the 
I'Xtt’a  repeat  Code  comb i nat 1 uns  ,uv  rejected.  In  this  process  a  coi:  1  :  na  t  i  on 
is  not  issued  to  a  recipient  it'  it  is  a  repetition  of  a  previously  t  ran. si:,  i  t  t  ed 
comb  i  nut  i  on  occurring  as  a  consequence  of  t  runs  t  urn  at  i  ■  n  et  a  vonf  l  rm.at  i  on 
•ignal  :n'.  ail  i  liter  rogut  i  on  signal  in  the  iM-rsc  cbaniu.  1  . 


We  will  use  I1  .  to  denote  the  probab  i  I  i  t  v  et  incorrect  recent  i  on  el  a 
cunt  1 

coni  l  mat  i  on  signal.  liien  tin-  p  rehab  i  1  i  ty  that  a  combination  used  in  the  i 
ward  channel  is  not  an'  extra  repetition  is  equal  tip  .  In  1  i  rht  ,  •' 

this  the  rate  •..>  f  relative  rate  o!  t  ran  um  ss  i  on  in  a  •dr.phsl  e--.teii;  is 
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in  a  blocking  system 
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and  in  a  duplex  system  with  separable  service  signals 
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1  he  correction  'introduced  here  cun  greatly  redum  t  lie  rate  o!  t  ransmi  ss  i  u: 
if  u  confirmation  signal  is  often  transformed  intc  ar.  interrogation  signal, 
lo  avoid  this  the  asymmetry  of  t  lie  principle  lor  decoding  service  pulse  train.- 
should  not  be  pushe'd  to  the  limit. 
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(O.SJ  as  des  i  red  by  selection  of  the  ode.  !■  r 
t o  have  a  large  lumber  of  checl  symbols  n  -  . 

-  y 

'  1U  ;  when  n  -  :  -  at)  I’  10.  a  '  in  ;  when  n 

lie 

lor  this  purpose  it  i>  not  at  all  necessary  tor 
dancy.  Thus,  the  code  examined  abot-  c-3 ,  -13 

has  a  redundancy  of  only  about  0.39. 
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In  many  channels  "incomplete"  disruptions  in  voiamuni  cat  l  or.  may  occur  when 
the  probability  of  error  p  is  close  to  0.3  but  does  not  reach  this  value.  \ 
question  occurs  as  to  whether  it  is  possibb  to  gu.n.mtee  tiiat  ;  r.  all  state- 
of  a  channel  the  nrobahilitv  of  an  undetected  error  uoi  s  not  ;  v  ••fd  I’  f  0 . 3  • 

Ilf 

as  ca  1  cu  1  a  t  et!  from  formulas  ;  I  1  .  S  ).  I  he  answei  will  is  a  ff  i  rr.a  t  i  \  e  if  f  is 


about  ten  combinations  will  be  recorded  when  p  =  10  ,  i.e.,  three  orders 

higher  than  the  v  lue  which  was  considered  as  permissible.  This  does  not 

_  ^ 

occur  m  blocking  since  when  p  5-10  “  an  average  of  one  cede  combination  will 
be  recorded  during  a  period  of  a  day  or  longer.  At  the  same  time  the  existence 
of  blocking  has  almost  no  effect  on  the  average  transmission  rate  as  is 
apparent  from  a  comparison  of  the  curves  for  p  =  lu"-  i.e.,  in  that  state 
when  most  of  the  information  is  transmitted. 

5.  (See  Section  1 1  . -1 J  In  most  works  interrogations  systems  in  a  con¬ 
tinuous  channel  are  considered  in  which  the  decision  to  interrogate  is  reached 
not  by  comparison  of  readings  of  the  demodulator  with  the  thresholds  of  the 
zero  zone  but  by  analysis  of  the  shape  of  the  envelope  of  the  received  sum  of 
signal  and  interference  which  are  not  subjected  to  optimal  (or  suboptimal) 
processing  in  matched  filters  or  devices  equivalent  to  them.  By  way  of  cri¬ 
teria  for  evaluation  of  the  shape  of  a  signal,  use  is  made  of  boundary  dis¬ 
tortions,  splitting,  or  other  parameters  obtained  from  a  comparison  of  signal 
shape  with  a  certain  standard.  These  methods  are  based  on  the  fact  that  there 
is  a  correlation  between  states  of  a  channel  and  distortions  in  the  shape  of  the 
envelope.  Nevertheless,  they  may  not  provide  for  an  optimal  statistical  evalua¬ 
tion  of  the  state  of  a  channel  and  therefore  lead,  compared  with  the  zero  zone 
method,  to  a  reduction  either  in  level  of  fidelity  or  rate  of  transmission. 

At  the  same  time  they  are  no  simpler  then  optimal  or  suboptimal  methods  with  a 
zero  zone. 

t>.  (See  Section  11.5)  The  principle  problem  in  constructing  a  system  with 
information  feedback  is  protection  against  transformation  of  a  negation  signal 
into  a  combination  of  the  main  message  or  vice  versa.  Although  these  phenomena 
do  not  directly  cause  errors  in  a  message  arriving  for  a  recipient  (if  the 
little  likely  cases  of  image  errors  are  neglected),  they  may  lead  to  overloading 
or  units  in  the  buffer  memory  on  the  transmitting  or  receiving  end  and  there¬ 
by  disrupt  transmission.  Therefore,  it  is  always  necessary  to  introduce  a 
certain  amount  of  redundancy  in  order  to  protect  a  negation  signal  from  such 
t  rans  format i ons . 

In  transmission  from  sources  with  a  controllable  rate  the  need  for  a 
buffer  memory  on  the  transmitting  end  disappears.  Therefore,  in  such  systems 
the  use  of  information  feedback  is  more  advisable  especially  if  it  is  possible 
to  use  a  memory  unit  with  a  large  capacity  on  the  receiving  end.  The  indicated 
problems  can  be  solved  relatively  easily  in  those  cases  when  brief  messages 
are  to  be  transmitted.  Nevertheless,  concern  should  always  be  shown  for  pro¬ 
tecting  a  negation  signal  against  t rans forma t i on  [s]. 
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CCNCLUr  ION 


Hu*  questions  examined  in  this  book  and  the  results  derived  enable  as 
to  compare  different  systems  of  t  ransmi  tt  i  ng  discrete  messages  and  wisely 
select  the  best  system  for  any  given  conditions.  This  selection  reduces  to 
determination  of  the  coding  method,  the  system  and  method  o!  signal  formation, 
method  of  reception,  etc.  'I he  author  will  deem  his  task  fulfilled  to  a  sub¬ 
stantial  degree  if  he  has  succeeded  in  convincing  the  reader  of  the  importance 
of  caret'll!  eons  i  derat  ion  of  all  channel  characteristics,  without  which  a  chosen 
system  will  lever  make  a  good  showing. 

It  would,  however,  be  a  mistake  to  try  to  find  universal  solutions  here 
which  would  make  it  possible  to  design  an  optimum  system  of  communications 
from  a  few  given  parameters.  I  he  relations  given  and  formulas  and  graphs  worked 
out  can  serve  as  basic  data  for  the  design  of  systems  for  transmitting  discrete 
messages,  but  they  are  by  n>  means  ready-made  prescriptions.  There  can  be  no 
such  prescri pt i ons  because  the  conditions  under  which  communications  systems 
operate  are  extremely  varied.  Under  different  conditions  various  engineering, 
economic,  tactical,  or  other  demands  affecting  the  design  of  the  whole  system 
or  of  individual  parts  thereof  may  plav  the  dominant  role. 

In  the  design  of  conmuni cut  ions  systems  certain  supplementary  stipulations 
may  be  made  depending  on  the  specific  use  to  which  they  are  to  he  put.  In  some 
eases,  for  example,  the  economic  factor  is  decisive  and  the  system  must  he  so 
designed  as  to  afford  the  least  total  expenditure  on  construction  of  the  equip¬ 
ment  and  its  operation  for  a  certain  period  of  time.  In  other  cases  tin*  correct 
criterion  may  be  minimum  weight  or  volume  of  the  whole  apparatus.  At  times  the 
requirements  as  to  weight  m.i  volur.o  may  1'ffer  for  the  sending  and  laceivinv 
equipment  ,  for  exam;  le  ,  when  one  ot.d  of  the  conmuni  i  at  i  ons  line  is  <tainmur\ 
and  the  other  on  a  nnving  ebie.t. 

heverthe  It  ss ,  in  .ill  tie.  numerous  i.oi 
skill  jii  evt  Uniting  the  probability  ■!'  erroi 
change  m  certain  van  it  mn  of  the  .  -tor 
ldefed  q  preach  to  the  pi  abler,  laced. 

I  he  v  ,i-t  majority  t  the  ~\  Urr-  lor  transmitting  Jiscrrte  r.ess  jges  whirl 
aie  at  present  in  operation  are  I  ir  iron  bein>,  opt  mi::.  \  partial  e \pl anat  i an 

of  this  is  that  developing  and  putting  ;  n  t  o;  >  ration  new  "e..n'-  of  e  om,r  an  i  c,- 1  i  ■  r. 
usually  takes  many  y>  am ;  and  this  '"ads  tv  a  a  om  i  derah  le  lag  -I  pi.utic.il 
a  ccomp  I  i  shment  s  behind  tlvon-t  i  c.i !  adv  in  is.  \nother  rason  :oi  this  lap  is 
the  inadeuuate  acqua  i  n!  aii.e  on  tin  pui  t  ut  i.  any  eng  i  me  r>  engaged  in  the  develop 
me  nt  and  operation  of  comm  :  cut  .  mis  sister.:-  with  the  latest  theoretical  finding 
\  not  un  imp  »rt  ant  lei-  in  th  i  <  is  p  1  a\  •  d  b>  the  i  nuccrss  i  b  i  1 , :  v  o  *  many  theme 
t  i  ca  1  wails  ,  mse  ot  t  he  comp  !r*  i  ?>  el  tie  mat  ber.it  i  es  used  an  1  because  t  ht-v 
do  not  lea  i  t"  pr<-c;  s*  reui::::.  iul.it  n  n;  . 


•<  ot  eorrain  i  eat  i  ons  systems  design, 
and  i r  determining  how  it  will 
■  a  neci  ■  sarv  condition  for  i  co* 
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In  this  connection  it  innv  In'  remarked  that  during  the  maily  years  of  t he 
existence  of  general  communication  theory  (approximately  until  the  middle  of 
the  lyf'O's)  the  chief  theoret  ical  Jesuits  consisted  in  explaining  and  generali¬ 
zing  the  methods  of  communication  which  up  to  that  time  had  already  been  formed 
mainly  on  the  intuition  of  their  developers  (e.g.,  pulse-code  modulation.,  scon- 
element  error-detect ing  code,  <‘tc.J.  In  the  last  few  years  the  situation  has 
changed  and  theory  has  begun  to  exert  an  active  influence  on  the  development  of 
new  systems  (e.g.,  kineplex,  hake,  etc.). 

Here  it  is  appropriate  to  point  out  that  the  tremendous  achievements  in 
the  field  of  developing  various  communication  systems  over  a  period  of  many  di- 
cades  during  which  communication  theory  was  coming  into  being  were  the  result 
of  "natural  selection."  Along  with  methods  of  transmission  an  1  reception 
greatly  advanced  for  their  time  and  which  became  firinlv  implanted  in  the  arsenal 
of  modern  technology,  many  inventors  suggested  and  developed  every  ya  ar  various 
systems  which  did  not  withstand  the  test  of  time.  Ivon  now  great  sums  are 
wasted  on  experimental  research  of  communication  methods  which  could  be  imme¬ 
diately  rejected  as  a  result  of  theoretical  analysis.  At  the  same  time  many 
.achievements  in  theory  have  been  clearly  put  to  inadequate  use  in  practice. 

Thus,  in  electric  wire  commtin  i  rat  i  on  almost  no  use  is  mule  of  optimal  or 
close-to-r.pt  imal  methods  of  processing  a  signal.  Specialists  in  tins  area  still 
are  under  the  impression  that  the  principal  problem  in  a  comnuni  at  ion  system 
is  to  reproduce  the  shape  of  a  traismitted  signal  as  accurately  as  possible 
while,  in  actuality,  only  extraction  of  the  information  contained  in  it  is  im¬ 
portant.  It  is  often  said  m  jus  t  i  f  i  cat  i  on  of  cionoptimal  systems  in  which 
much  information  is  lost  that  in  cable  channels  fluctuation  noise  is  so  insig¬ 
nificant  that  existing  methods  of  reception  provide  for  a  high  level  ot  fidelity. 
But  this  situation,  as  already  noted,  has  led  to  clearly  inadequate  use  of 
channel  carrying  capacity.  I  he  app  I  i  c  it  i  «>n  of  vary  simple  mothoJs  for  optimi¬ 
zing  the  shape  of  a  signal  and  processing  it  would  have  rude  it  possible  to 
greatly  increase  the  rate  of  information  transmission  (e.g.,  grt  it  ly  increase 
tin’  multiplexing  factor)  and  won  lit  have  yielded  great  economic  gain. 

A  consideration  of  the  radio  common  i  cat  i  on  system  with  frequency  key  mg 
ill  widest  use  shows  that  modernization  of  it  bused  on  the  nv  of  only  the  sim¬ 
plest  practicable  recommendations  of  theory  t  ipph.ation  of  "..itched  filters  for 
orthogonal  signals,  effective  methods  of  adding  m  diversity  reception,  suitable 
methods  for  suppressing  impulse  i  nt  erference ,  me  at'  feedback  channels,  eti.' 
could  have  provided  a  power  gain  on  the  order  of  1 0  -  JO  db .  Ibis  means  that 
while  retaining  the  same  level  ot  tub  !;t\  and  recent  i  or:  1 1  would  have  been 
possible  to  reduce  transmitter  power  bv  ten  t  i  r  •  ej  while  i  ■  t  re  Mg  tin  s.ir  e 
power  to  greatly  i:;. reuse  the  Uvi-I  ,  f  j;delit\  ,  i\  uing  non  .o'-plex  rirth.wK 
it  is  possible  with  the  present  level  of  equipment  ti  inuti  cor, nun  i  cat  i  on 
systems  yielding  greater  power  gains  md  i!m'  permitting  a  gre  it  increase  ,  r, 
the  rate  ot  inform  it  ion  t ransmi << i on . 

\mong  the  trends  noted  in  the  past  few  years  n.  the  development  ot  systems 
for  the  transmission  of  discrete  i  nf 'mat  i  on  particular  it  tent  ion  should  be  ie 
voted  to  the  use  of  a  feedback  channel  in  all  cases  where  s  i  h  ;  <  .  I  r.  i  on  mtu  - 
t  i  on  with  a  wisely  selected  method  et  coding,  teedb.ul  svster  prevnli  1  r  i 
high  level  of  fidelity  and  reception  when  the  characteristic.,  of  ,  ,  h.ainr !  in 
least  ‘avorublc. 
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Another  promising  trend  (at  least  lor  radio  channels  employing  iono¬ 
spheric  or  tropospheric  wave  propagation)  is  the  use  of  wideband  signals.  As 
was  indicated,  such  systems  permit  actively  combatting  multibeam  wave  propaga¬ 
tion  and  also  using  this  phenomenon  to  increase  the  fidelity  of  reception. 

They  provide,  furthermore,  for  the  possibility  of  reliable  suppression  of  im¬ 
pulse  interference  and  also  used  some  conditions  simplify  the  problem  of 
assigning  a  large  number  of  chamu  Is  to  a  limited  frequency  range. 

It  should  be  noted  that  for  the  implementation  of  optimal  or  clos'-to- 
optimal  common i cat i on  systems  ,  high  frequency  prevision  which  is  not  allays 
achievable  with  the  present-day  level  of  equ.pmeiit  to  stabilize  f  p'quenc  i  es 
is  required.  Ibis  forces  resort  in  some  ease  to  automatic  frequency  tuning. 

The  essence  of  automatic  tuning  amounts  to  transmjtt'ug  over  a  communication 
channel,  along  with  the  main  message,  i  nf  orm.it  i  an  ai-out  a  reference  frequency 
used  in  shaping  the  signal.  i'his  infona.it  iui  is  extracted  by  the  receiving 
device  and  used  in  the  decision  circuit  for  reception  of  the  main  message. 

fhe  transmission  of  information  a. ••out  frequency  ent.hls  mam  interesting 
problems.  Included  in  them  are  problems  concerting  tin  required  additional 
channel  carrying  capacity,  the  best  nr th  uh  of  extraction  and  use  of  this  in- 
tormation,  possible  methods  of  coding,  etc.  Unf  'rfanat  e  l\  ,  the  extent  of  this 
work  does  not  permit  devoting  attention  to  these  pi  norms. 

Ill"  problem  of  s»  nchroti  i  ;  i  ng  decision  circu.ts  is  c.osely  associated  with 
this.  Usually  a  distinction  is  made  ’  eiwreii  beat  (determination  of  instants 
of  arrival,  ei'  beginning  of  signal  elements  and  cyclical  synchronization  (deter 
munition  of  firs?  -ymbel  m  a  code  comb  i  na  t  1  or.  •  .  lliese  problems  have  been 
rather  well  resolved  m  niod.-rn  communi  eat  n>n  equipment,  at  least  in  incoherent 
reception  circuits.  However,  •>  >  licit  roll  i  :  at  i  on  theory  his  been  little  developed 
and  it  is  ditficul:  to  s.q\  what  possibilities  will  be  t  ou..u  in  it  lor  im¬ 
proving  and  simp) , tying  existing  systems.  I  he  re". .re,  we  are  forced  to  limit 
ourselves  to  a  cons » deiv.t  i  >n  of  the  effect-  of  in.wuir.wvs  .n  --v  nch  ron  i  :at  i  on 
on  t  nt  e  rt  e  ri-nce  resistance  and  t  siVe-r.i!  general  idea. 

\  wiue  range  ot  ;  rol-f-re  aii-e-  it  c  u.K  ;  ng  mi  t  hods  tor  extracting  u, for¬ 
mation  about  the  state  of  ,i  channel  !r-  •  -i^n.il  i  sp,  c  i  f  i  i  a  1  I  x  ,  instantaneous 

values  of  the  con  pollen  t  s  oi  tin-  t  i  .mo  ;  -t  t.ut  i  tin!  its  use  tor  optirizitig 

sigiii.il  p  rocess- 1  ng .  l\c  wen-  trr,eJ  in  cost  ,  m  s  t,>  |;rit  ourselves  to  a  con 
side-ration  of  two  extreme  sitmti.  sis  when  rotlui.g  w  ,.s  l wi.  e  out  the  value  et 
the  transmission  laeto-  imi  when  it  i-  )  nowr  i  i.i.tb  .  It  i  >  s  i  uo  that  :  r  "air. 
cases  this  m format  ion  has  l  i J  t  ) i  r  ■  -  *  tr  t  •  -n  »esi st  .uut  ’  o  interten  nee 

but  some  t :  )t  e  ,  for  e.»  ir.p  I  ,  in  d  i  v  e  i  s  ;  t  >  n  o-jti  n  ,  s«  -  ,t  ct  i '  e  lading,  inti  i  • 

rogation  sxstem.S,  e  t-  .,  It  t  s  c'trinel'.  import  ant  .  Ihe  t  ask  erects  to  pt  • 
Jicting  the  values  o!  the  triiNnoMi  !  e  t  or  b.i<ed  on  ot  so:  v  at  i  mix  et  signal 
over  a  certain  segment  of  tine  ,-ul  to  syritin  i  ••  et  decision  circuits. 

Manx  other  pf  yb  letr.s  which  have  net  vet  been  completely  :o  solved  were  not 
considered  m  the  bool  .  \  detailed  1  i  st  i  in.  t  them  would  tale  tec  much  space. 
Undoubtedly,  with  further  de"  r  I  opraenii  in  tin  tin  r\  and  • .  hnole.  gx  o!  trails 
matting  di-rrte  messages,  these  pri  b  3er  s  will  ‘a  1 1  .  1  •  J .  but  it  the  same  t  ir.i 

lile  will  present  us  with  new  problems. 
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PRINCIPAL  SYMBOLS  USED 


Mtj 

V  Bk 

a,.L>  b 


rk  ’  rk 


B 

C 

I) 

d 


envelope  of  received  signal 

l-'ourior  coeffi  ei  ents  of  a  received  signal 

Fourier  coefficients  of  a  transmitted  signal  element  corres¬ 
ponding  to  symbol  n 

base  of  signal  (systomi  (B  -  JIT) 

channel  passband 

kotelnikov  distance  between  signals 
Hamming  distance  between  code  combinations 


f:i  (x) 


1  r  * 


integral  exponential  function 


G(fj 

lilt) 

il(  ) 

II'  (x.) 

h  (x) 

*) 

h" 

i U.y) 

I’ U.y) 

In(xJ  =  j"n<,n(Jx) 
Jn(x) 

k 

k 

1. 

L,M 


stipulated  signal  frequency  band  (of  a  system) 
power  spectral  density 

impulse  response  of  a  linear  system  (of  a  filter) 
ont ropy 

productivity  of  message  source,  entropy  per  unit  time 
differential  entropy 

ratio  between  power  of  signal  element  and  interference 
spectral  density 

mathematical  expectation  of  h“  when  there  is  fading 

amount  of  information  contained  in  x  relative  to  v 

rate  of  transmission  of  information  contained  in  x  relative 
to  y 

Bessel  function  of  imaginary  argument 
Bessel  function  of  the  n-th  order 

ratio  between  regular  component  of  transmission  coefficient 
and  fluctuating  component 

divisibility  of  channel  multiplexing 

duration  of  channel  reaction  to  impulse 

parameters  describing  rate  of  fading 

size  of  source  alphabet 


m 


code  base 


-573- 


n  ( t  l 


P 

s 

I’.  p 

p  (  ' ,  p  (  ) 


number  oi'  symbols  in  code  combination 

systematic  code,  combinations  of  which  contain  k  information 
symbols  and  n  -  k  verification 

additive  interference 

power 

signal  power 
probab i 1 i ty 
probability  of  error 


I’c 

Q 


probabi'ity  of  incorrect  reception  of  a  group  signal  in  a 
multiplexed  channel 

equivalent  probability  of  error 

number  of  branches  in  diversity  reception 


Q  (-V,  //) 


j  /„  ( '.vf  ih,  Q- function 


q 

II,  r,  R(r) 


ratio  between  mean -square  values  of  signal  and  interference 
at  detector  input 

correlation  coefficient 


S 

s 

s(j~) 


state  of  source  or  channel 
relative  transmission  rate 
filter  transfer  function 


si(.v)  ~p 


vr>  Xr-  Yr 

w(  ) 

X 


X  1 


y 

y  ’ 

z 

z  1 


z(t) 


integral  sine 

duration  of  signal  element 

duration  of  part  of  signal  element  being  analyzed 
magnitudes  determined  by  formulas  (3.10)  and  (4.11) 
density  of  probability  distribution  of  a  random  variable 
transmitted  message 
received  message 

transmitted  code  symbol  or  sequence  of  code  symbols 

received  code  symbol  or  sequence  of  code  symbols 

transmitted  signal 

received  signal 

function  conjugate  with  z(t) 

Pouriei  coefficients  of  an  clement  of  interference 
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coefficient  i  i.  (.■>.{•!)  iU  | ' t • : u  1  i  ac  0:1  <  i  ..n.<  I  : 
effective  noi-'C  , > 1 ■  -d>  and 

indicator  of  t  ransv.i  1 1  <  i  umann  it  ..  i  ■ 

channel  t  ransmi  ss  1  or  faitoi 

coplVisal  and  i|iiad  rat  lire  component  •  t  r  ;n  1  <  : 
regular  component  of  transfer  ocelli  dent 
f  1  ue  t  licit  i  no  .vrri'ii  nt  .  f  msfe>  >ff;Citi  * 
interference  spectral  ilnmi'y 
parameter  of  nenert hojtor.  i !  i  t y 
d  i  s pel's  i .  n 

di  specs  i  a  Mf  lomrior  .. i  c  i .  ■>  :  •  -,t  •  •  t  •  . 

interval  of  cor*  - 1  at  i  >•;:  of  •  niiu; 

,!x  t.rar.pe  timcti  n 

i n i t i  « 1  phase 


angular  f reeptenev 

The  mathematical  expert  at  ion  ,.f  a  ramie!..  .  ;•  <  a!  '<■  .■  .  i:  :  i  c..t  . 

r  or.  t  a  1  line,  for  example:  .•  ,  s  the  mother  iticai  era  rt.i!  a  n  •  h.e 
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